2026-03-30 09:05:03 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 09:05:03 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 09:05:03 [auto1.it] INFO: Batch mode enabled: batch 2/2
2026-03-30 09:05:03 [auto1.it] INFO: Starting spider auto1.it
2026-03-30 09:05:03 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 09:05:03 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 09:05:03 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 09:05:03 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 09:05:03 [scrapy.extensions.telnet] INFO: Telnet Password: ca2fa66157bf3b0b
2026-03-30 09:05:03 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 09:05:03 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_23_2026-03-30T09_05_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 09:05:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 09:05:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 09:05:03 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 09:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 09:05:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 09:05:03 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2111
2026-03-30 09:05:03 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 09:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:04 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 09:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 09:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 09:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 09:05:04 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 09:05:04 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 09:05:04 [scrapy.core.engine] INFO: Spider opened
2026-03-30 09:05:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 09:05:04 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-30 09:05:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-30 09:05:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 09:05:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 09:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 09:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 09:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 09:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 09:05:13 [auto1.it] INFO: Channel: 24h | Page: 0 | totalHits: 3302 | hits on page: 40
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: AU57625
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: DG51185
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG51185%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [auto1.it] INFO: Scrape type for DG51185: 1
2026-03-30 09:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: CS27755
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: YS50306
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: GC16915
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: TT31796
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT31796%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [auto1.it] INFO: Scrape type for TT31796: 1
2026-03-30 09:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: EG63290
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: VJ08393
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ08393%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [auto1.it] INFO: Scrape type for VJ08393: 1
2026-03-30 09:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: SF67196
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: US29444
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US29444%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [auto1.it] INFO: Scrape type for US29444: 1
2026-03-30 09:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:13 [auto1.it] INFO: Found listing with ID: AB32606
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB32606%27 HTTP/1.1" 200 None
2026-03-30 09:05:13 [auto1.it] INFO: Scrape type for AB32606: 2
2026-03-30 09:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccabfe03-10fa-5063-bd02-baf713e1dde8 with identifier: AB32606
2026-03-30 09:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccabfe03-10fa-5063-bd02-baf713e1dde8 with scrape type 2
2026-03-30 09:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccabfe03-10fa-5063-bd02-baf713e1dde8 with scrape type 2
2026-03-30 09:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ccabfe03-10fa-5063-bd02-baf713e1dde8, identifier: AB32606
2026-03-30 09:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ccabfe03-10fa-5063-bd02-baf713e1dde8 with identifier: AB32606
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 09:05:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 09:05:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ccabfe03-10fa-5063-bd02-baf713e1dde8 with identifier: AB32606
2026-03-30 09:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ccabfe03-10fa-5063-bd02-baf713e1dde8 with identifier: AB32606 to the API
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-31T15:48:39Z',
 'fuel_type': 'hybrid',
 'id': 'ccabfe03-10fa-5063-bd02-baf713e1dde8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB32606',
 'listing': 'auction',
 'make': 'Lynk & Co',
 'model': '01',
 'odometer': 55653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-21',
 'seller_name': None,
 'title': 'Lynk & Co 01 1.5 Plug-in Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB32606%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [auto1.it] INFO: Saving data for AB32606: {'auction_closing_time': 1774972119.0, 'created_time': 1774559298.466595, 'last_price_update_time': 1774861514.689987}
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB32606') HTTP/1.1" 204 0
2026-03-30 09:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: NN22737
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: XS82719
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: DV11825
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: ME60194
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME60194%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [auto1.it] INFO: Scrape type for ME60194: 1
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: CL00266
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: LW39241
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: FL33491
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL33491%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [auto1.it] INFO: Scrape type for FL33491: 1
2026-03-30 09:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: UC46466
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: YH22657
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: KJ37946
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ37946%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [auto1.it] INFO: Scrape type for KJ37946: 1
2026-03-30 09:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: WR11304
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR11304%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [auto1.it] INFO: Scrape type for WR11304: 1
2026-03-30 09:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: UM30901
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM30901%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [auto1.it] INFO: Scrape type for UM30901: 1
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: KS72345
2026-03-30 09:05:14 [auto1.it] INFO: Found listing with ID: DR56605
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR56605%27 HTTP/1.1" 200 None
2026-03-30 09:05:14 [auto1.it] INFO: Scrape type for DR56605: 2
2026-03-30 09:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d23d65-bef6-564f-95d4-b8cc271ee256 with identifier: DR56605
2026-03-30 09:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d23d65-bef6-564f-95d4-b8cc271ee256 with scrape type 2
2026-03-30 09:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d23d65-bef6-564f-95d4-b8cc271ee256 with scrape type 2
2026-03-30 09:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 32d23d65-bef6-564f-95d4-b8cc271ee256, identifier: DR56605
2026-03-30 09:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 32d23d65-bef6-564f-95d4-b8cc271ee256 with identifier: DR56605
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 09:05:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 32d23d65-bef6-564f-95d4-b8cc271ee256 with identifier: DR56605
2026-03-30 09:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 32d23d65-bef6-564f-95d4-b8cc271ee256 with identifier: DR56605 to the API
2026-03-30 09:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:18:16Z',
 'fuel_type': 'diesel',
 'id': '32d23d65-bef6-564f-95d4-b8cc271ee256',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR56605',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 180871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-29',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Premium L2',
 'transmission': 'manual',
 'trim': 'Premium L2',
 'year': 2018}
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR56605%27 HTTP/1.1" 200 None
2026-03-30 09:05:16 [auto1.it] INFO: Saving data for DR56605: {'auction_closing_time': 1774970296.0, 'created_time': 1774440415.154005, 'last_price_update_time': 1774861516.440538}
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DR56605') HTTP/1.1" 204 0
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: EG14911
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG14911%27 HTTP/1.1" 200 None
2026-03-30 09:05:16 [auto1.it] INFO: Scrape type for EG14911: 1
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: SE55606
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE55606%27 HTTP/1.1" 200 None
2026-03-30 09:05:16 [auto1.it] INFO: Scrape type for SE55606: 1
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: TP54883
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: UH51209
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: WL93075
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: LU79948
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU79948%27 HTTP/1.1" 200 None
2026-03-30 09:05:16 [auto1.it] INFO: Scrape type for LU79948: 1
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: JN50634
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: XN71458
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: AX59226
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX59226%27 HTTP/1.1" 200 None
2026-03-30 09:05:16 [auto1.it] INFO: Scrape type for AX59226: 1
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: BS95687
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: PE32711
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: LR70386
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: XY37684
2026-03-30 09:05:16 [auto1.it] INFO: Found listing with ID: NA99278
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA99278%27 HTTP/1.1" 200 None
2026-03-30 09:05:16 [auto1.it] INFO: Scrape type for NA99278: 2
2026-03-30 09:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 244de408-1a27-52a4-b007-56c21f5ceeaa with identifier: NA99278
2026-03-30 09:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 244de408-1a27-52a4-b007-56c21f5ceeaa with scrape type 2
2026-03-30 09:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 244de408-1a27-52a4-b007-56c21f5ceeaa with scrape type 2
2026-03-30 09:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 244de408-1a27-52a4-b007-56c21f5ceeaa, identifier: NA99278
2026-03-30 09:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 244de408-1a27-52a4-b007-56c21f5ceeaa with identifier: NA99278
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 09:05:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 244de408-1a27-52a4-b007-56c21f5ceeaa with identifier: NA99278
2026-03-30 09:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 244de408-1a27-52a4-b007-56c21f5ceeaa with identifier: NA99278 to the API
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:18:02Z',
 'fuel_type': 'diesel',
 'id': '244de408-1a27-52a4-b007-56c21f5ceeaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA99278',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 94636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-29',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active L1',
 'transmission': 'manual',
 'trim': 'Active L1',
 'year': 2021}
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA99278%27 HTTP/1.1" 200 None
2026-03-30 09:05:17 [auto1.it] INFO: Saving data for NA99278: {'auction_closing_time': 1774970282.0, 'created_time': 1773132379.233253, 'last_price_update_time': 1774861517.406925}
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NA99278') HTTP/1.1" 204 0
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: FD34465
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD34465%27 HTTP/1.1" 200 None
2026-03-30 09:05:17 [auto1.it] INFO: Scrape type for FD34465: 1
2026-03-30 09:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT31796/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ08393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG51185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:17 [auto1.it] INFO: Channel: 24h | Page: 1 | totalHits: 3303 | hits on page: 40
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: DJ98895
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: AU57625
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: DG51185
2026-03-30 09:05:17 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/DG51185/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: CS27755
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: YS50306
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: GC16915
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: TT31796
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: EG63290
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: VJ08393
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: SF67196
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: US29444
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: AB32606
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB32606%27 HTTP/1.1" 200 None
2026-03-30 09:05:17 [auto1.it] INFO: Scrape type for AB32606: 0
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: NN22737
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: XS82719
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: DV11825
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: ME60194
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: CL00266
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: LW39241
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: FL33491
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: UC46466
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: YH22657
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: KJ37946
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: WR11304
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: UM30901
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: KS72345
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: DR56605
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR56605%27 HTTP/1.1" 200 None
2026-03-30 09:05:17 [auto1.it] INFO: Scrape type for DR56605: 0
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: EG14911
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: SE55606
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: TP54883
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: UH51209
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: WL93075
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: LU79948
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: JN50634
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: XN71458
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: AX59226
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: BS95687
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: PE32711
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: LR70386
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: XY37684
2026-03-30 09:05:17 [auto1.it] INFO: Found listing with ID: NA99278
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA99278%27 HTTP/1.1" 200 None
2026-03-30 09:05:17 [auto1.it] INFO: Scrape type for NA99278: 0
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ37946/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US29444/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL33491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME60194/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM30901/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR11304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD34465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX59226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG51185> (referer: https://www.auto1.com/v1/car-details-view/DG51185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE55606/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ08393> (referer: https://www.auto1.com/v1/car-details-view/VJ08393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b06c211-01e0-5e2d-a44a-bfd58bd1074c with identifier: DG51185
2026-03-30 09:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b06c211-01e0-5e2d-a44a-bfd58bd1074c with scrape type 1
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b06c211-01e0-5e2d-a44a-bfd58bd1074c
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F9b%252F389bfe6325533a9e06e0f78a83c9f034%252Fpa%252FDG51185_87e6ca33bbc42b1100f404653bf6c3e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_87e6ca33bbc42b1100f404653bf6c3e4.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F9b%252F389bfe6325533a9e06e0f78a83c9f034%252Fpa%252FDG51185_051eb73fddc25448e40ddea632a1e8a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_051eb73fddc25448e40ddea632a1e8a6.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F9b%252F389bfe6325533a9e06e0f78a83c9f034%252Fpa%252FDG51185_c4cd300cc7707e762fb07dfcb9e62e52.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_c4cd300cc7707e762fb07dfcb9e62e52.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F9b%252F389bfe6325533a9e06e0f78a83c9f034%252Fpa%252FDG51185_cd74c2821ff7c3006225becb6e55546c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_cd74c2821ff7c3006225becb6e55546c.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F9b%252F389bfe6325533a9e06e0f78a83c9f034%252Fpa%252FDG51185_e3a68e0b2f49ec5c29f5828138a2376f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_e3a68e0b2f49ec5c29f5828138a2376f.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F9b%252F389bfe6325533a9e06e0f78a83c9f034%252Fpa%252FDG51185_f3946b055df089ae161ebdd26c19dc85.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_f3946b055df089ae161ebdd26c19dc85.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F9b%252F389bfe6325533a9e06e0f78a83c9f034%252Fpa%252FDG51185_8bce238a2fe1f22f19a95d1c3e3cf7a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_8bce238a2fe1f22f19a95d1c3e3cf7a8.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F9b%252F389bfe6325533a9e06e0f78a83c9f034%252Fpa%252FDG51185_b23729584006bb7b76c50d54fd74745d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_b23729584006bb7b76c50d54fd74745d.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F9b%252F389bfe6325533a9e06e0f78a83c9f034%252Fpa%252FDG51185_34011dea659463662f42b45371736d79.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_34011dea659463662f42b45371736d79.jpg already downloaded
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252F9b%252F389bfe6325533a9e06e0f78a83c9f034%252Fpa%252FDG51185_7187eff52facb368ae4ec50fba229b74.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_7187eff52facb368ae4ec50fba229b74.jpg already downloaded
2026-03-30 09:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4b06c211-01e0-5e2d-a44a-bfd58bd1074c, identifier: DG51185
2026-03-30 09:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4b06c211-01e0-5e2d-a44a-bfd58bd1074c with identifier: DG51185
2026-03-30 09:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 09:05:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 09:05:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4b06c211-01e0-5e2d-a44a-bfd58bd1074c with identifier: DG51185
2026-03-30 09:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4b06c211-01e0-5e2d-a44a-bfd58bd1074c with identifier: DG51185 to the API
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DG51185>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:28:39Z',
 'fuel_type': 'gas',
 'id': '4b06c211-01e0-5e2d-a44a-bfd58bd1074c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG51185',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 195649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_87e6ca33bbc42b1100f404653bf6c3e4.jpg',
                'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_051eb73fddc25448e40ddea632a1e8a6.jpg',
                'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_c4cd300cc7707e762fb07dfcb9e62e52.jpg',
                'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_cd74c2821ff7c3006225becb6e55546c.jpg',
                'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_e3a68e0b2f49ec5c29f5828138a2376f.jpg',
                'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_f3946b055df089ae161ebdd26c19dc85.jpg',
                'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_8bce238a2fe1f22f19a95d1c3e3cf7a8.jpg',
                'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_b23729584006bb7b76c50d54fd74745d.jpg',
                'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_34011dea659463662f42b45371736d79.jpg',
                'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_7187eff52facb368ae4ec50fba229b74.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b06c211-01e0-5e2d-a44a-bfd58bd1074c/4b06c211-01e0-5e2d-a44a-bfd58bd1074c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_87e6ca33bbc42b1100f404653bf6c3e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b06c211-01e0-5e2d-a44a-bfd58bd1074c/4b06c211-01e0-5e2d-a44a-bfd58bd1074c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_051eb73fddc25448e40ddea632a1e8a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b06c211-01e0-5e2d-a44a-bfd58bd1074c/4b06c211-01e0-5e2d-a44a-bfd58bd1074c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_c4cd300cc7707e762fb07dfcb9e62e52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b06c211-01e0-5e2d-a44a-bfd58bd1074c/4b06c211-01e0-5e2d-a44a-bfd58bd1074c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_cd74c2821ff7c3006225becb6e55546c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b06c211-01e0-5e2d-a44a-bfd58bd1074c/4b06c211-01e0-5e2d-a44a-bfd58bd1074c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_e3a68e0b2f49ec5c29f5828138a2376f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b06c211-01e0-5e2d-a44a-bfd58bd1074c/4b06c211-01e0-5e2d-a44a-bfd58bd1074c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_f3946b055df089ae161ebdd26c19dc85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b06c211-01e0-5e2d-a44a-bfd58bd1074c/4b06c211-01e0-5e2d-a44a-bfd58bd1074c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_8bce238a2fe1f22f19a95d1c3e3cf7a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b06c211-01e0-5e2d-a44a-bfd58bd1074c/4b06c211-01e0-5e2d-a44a-bfd58bd1074c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_b23729584006bb7b76c50d54fd74745d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b06c211-01e0-5e2d-a44a-bfd58bd1074c/4b06c211-01e0-5e2d-a44a-bfd58bd1074c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_34011dea659463662f42b45371736d79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b06c211-01e0-5e2d-a44a-bfd58bd1074c/4b06c211-01e0-5e2d-a44a-bfd58bd1074c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/9b/389bfe6325533a9e06e0f78a83c9f034/pa/DG51185_7187eff52facb368ae4ec50fba229b74.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Benzin / LPG Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2019}
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG51185%27 HTTP/1.1" 200 None
2026-03-30 09:05:20 [auto1.it] INFO: Saving data for DG51185: {'created_time': 1774861520.893693, 'last_price_update_time': 1774861520.893707, 'auction_closing_time': 1774970919.0}
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DG51185') HTTP/1.1" 204 0
2026-03-30 09:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ37946> (referer: https://www.auto1.com/v1/car-details-view/KJ37946/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU79948/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:21 [auto1.it] INFO: Channel: 24h | Page: 2 | totalHits: 3303 | hits on page: 40
2026-03-30 09:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b06a9fbb-7326-5dac-8233-ae80965b7d10 with identifier: VJ08393
2026-03-30 09:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b06a9fbb-7326-5dac-8233-ae80965b7d10 with scrape type 1
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b06a9fbb-7326-5dac-8233-ae80965b7d10
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F4f%252F334fa34cde2d43726789af01dbaf328f%252Fpa%252FVJ08393_bd867cdba011b6d9cc078ad415ac949f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_bd867cdba011b6d9cc078ad415ac949f.jpg already downloaded
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F4f%252F334fa34cde2d43726789af01dbaf328f%252Fpa%252FVJ08393_5e6e875ee963003ba25dc4cb4e146223.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_5e6e875ee963003ba25dc4cb4e146223.jpg already downloaded
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F4f%252F334fa34cde2d43726789af01dbaf328f%252Fpa%252FVJ08393_40694d74b7fb9c809712a9a8dd7b4333.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_40694d74b7fb9c809712a9a8dd7b4333.jpg already downloaded
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F4f%252F334fa34cde2d43726789af01dbaf328f%252Fpa%252FVJ08393_f1e0920a1f7a7529e94f369ce174bad3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_f1e0920a1f7a7529e94f369ce174bad3.jpg already downloaded
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F4f%252F334fa34cde2d43726789af01dbaf328f%252Fpa%252FVJ08393_1e6a6e5dbbdf03311853d4847725975b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_1e6a6e5dbbdf03311853d4847725975b.jpg already downloaded
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F4f%252F334fa34cde2d43726789af01dbaf328f%252Fpa%252FVJ08393_34368664ee7c97fca994e3bff74e9891.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_34368664ee7c97fca994e3bff74e9891.jpg already downloaded
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F4f%252F334fa34cde2d43726789af01dbaf328f%252Fpa%252FVJ08393_9599a443a663be1e1c5fe9f699cf95f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_9599a443a663be1e1c5fe9f699cf95f5.jpg already downloaded
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F4f%252F334fa34cde2d43726789af01dbaf328f%252Fpa%252FVJ08393_34e554341bde2356393a97b8ade629aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_34e554341bde2356393a97b8ade629aa.jpg already downloaded
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F4f%252F334fa34cde2d43726789af01dbaf328f%252Fpa%252FVJ08393_9c53ce71471d9e89c5f9df6da1670e37.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_9c53ce71471d9e89c5f9df6da1670e37.jpg already downloaded
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F4f%252F334fa34cde2d43726789af01dbaf328f%252Fpa%252FVJ08393_584d311eea423fc91d4fb2c5206bac6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_584d311eea423fc91d4fb2c5206bac6f.jpg already downloaded
2026-03-30 09:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b06a9fbb-7326-5dac-8233-ae80965b7d10, identifier: VJ08393
2026-03-30 09:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b06a9fbb-7326-5dac-8233-ae80965b7d10 with identifier: VJ08393
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 09:05:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b06a9fbb-7326-5dac-8233-ae80965b7d10 with identifier: VJ08393
2026-03-30 09:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b06a9fbb-7326-5dac-8233-ae80965b7d10 with identifier: VJ08393 to the API
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VJ08393>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:50:53Z',
 'fuel_type': 'diesel',
 'id': 'b06a9fbb-7326-5dac-8233-ae80965b7d10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ08393',
 'listing': 'auction',
 'location': 'IT',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 156780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_bd867cdba011b6d9cc078ad415ac949f.jpg',
                'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_5e6e875ee963003ba25dc4cb4e146223.jpg',
                'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_40694d74b7fb9c809712a9a8dd7b4333.jpg',
                'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_f1e0920a1f7a7529e94f369ce174bad3.jpg',
                'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_1e6a6e5dbbdf03311853d4847725975b.jpg',
                'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_34368664ee7c97fca994e3bff74e9891.jpg',
                'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_9599a443a663be1e1c5fe9f699cf95f5.jpg',
                'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_34e554341bde2356393a97b8ade629aa.jpg',
                'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_9c53ce71471d9e89c5f9df6da1670e37.jpg',
                'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_584d311eea423fc91d4fb2c5206bac6f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b06a9fbb-7326-5dac-8233-ae80965b7d10/b06a9fbb-7326-5dac-8233-ae80965b7d10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_bd867cdba011b6d9cc078ad415ac949f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b06a9fbb-7326-5dac-8233-ae80965b7d10/b06a9fbb-7326-5dac-8233-ae80965b7d10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_5e6e875ee963003ba25dc4cb4e146223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b06a9fbb-7326-5dac-8233-ae80965b7d10/b06a9fbb-7326-5dac-8233-ae80965b7d10_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_40694d74b7fb9c809712a9a8dd7b4333.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b06a9fbb-7326-5dac-8233-ae80965b7d10/b06a9fbb-7326-5dac-8233-ae80965b7d10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 959159,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_f1e0920a1f7a7529e94f369ce174bad3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b06a9fbb-7326-5dac-8233-ae80965b7d10/b06a9fbb-7326-5dac-8233-ae80965b7d10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_1e6a6e5dbbdf03311853d4847725975b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b06a9fbb-7326-5dac-8233-ae80965b7d10/b06a9fbb-7326-5dac-8233-ae80965b7d10_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_34368664ee7c97fca994e3bff74e9891.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b06a9fbb-7326-5dac-8233-ae80965b7d10/b06a9fbb-7326-5dac-8233-ae80965b7d10_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_9599a443a663be1e1c5fe9f699cf95f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b06a9fbb-7326-5dac-8233-ae80965b7d10/b06a9fbb-7326-5dac-8233-ae80965b7d10_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_34e554341bde2356393a97b8ade629aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b06a9fbb-7326-5dac-8233-ae80965b7d10/b06a9fbb-7326-5dac-8233-ae80965b7d10_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_9c53ce71471d9e89c5f9df6da1670e37.jpg',
             'Width': 746},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b06a9fbb-7326-5dac-8233-ae80965b7d10/b06a9fbb-7326-5dac-8233-ae80965b7d10_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/4f/334fa34cde2d43726789af01dbaf328f/pa/VJ08393_584d311eea423fc91d4fb2c5206bac6f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ08393%27 HTTP/1.1" 200 None
2026-03-30 09:05:22 [auto1.it] INFO: Saving data for VJ08393: {'created_time': 1774861522.02658, 'last_price_update_time': 1774861522.026594, 'auction_closing_time': 1774972253.0}
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ08393') HTTP/1.1" 204 0
2026-03-30 09:05:22 [auto1.it] INFO: Found listing with ID: FD34465
2026-03-30 09:05:22 [auto1.it] INFO: Found listing with ID: TT47186
2026-03-30 09:05:22 [auto1.it] INFO: Found listing with ID: RX48220
2026-03-30 09:05:22 [auto1.it] INFO: Found listing with ID: TF73958
2026-03-30 09:05:22 [auto1.it] INFO: Found listing with ID: TM12989
2026-03-30 09:05:22 [auto1.it] INFO: Found listing with ID: DH32592
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH32592%27 HTTP/1.1" 200 None
2026-03-30 09:05:22 [auto1.it] INFO: Scrape type for DH32592: 2
2026-03-30 09:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77551967-fdf2-56e1-b439-8553446a5cae with identifier: DH32592
2026-03-30 09:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77551967-fdf2-56e1-b439-8553446a5cae with scrape type 2
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77551967-fdf2-56e1-b439-8553446a5cae with scrape type 2
2026-03-30 09:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 77551967-fdf2-56e1-b439-8553446a5cae, identifier: DH32592
2026-03-30 09:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 77551967-fdf2-56e1-b439-8553446a5cae with identifier: DH32592
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 09:05:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 77551967-fdf2-56e1-b439-8553446a5cae with identifier: DH32592
2026-03-30 09:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 77551967-fdf2-56e1-b439-8553446a5cae with identifier: DH32592 to the API
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:19:08Z',
 'fuel_type': 'petrol',
 'id': '77551967-fdf2-56e1-b439-8553446a5cae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH32592',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 111778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-15',
 'seller_name': None,
 'title': 'Hyundai i30 1.0 T-GDI Mild-Hybrid Prime',
 'transmission': 'automatic',
 'trim': 'Prime',
 'year': 2022}
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH32592%27 HTTP/1.1" 200 None
2026-03-30 09:05:22 [auto1.it] INFO: Saving data for DH32592: {'auction_closing_time': 1774970348.0, 'created_time': 1774354122.801506, 'last_price_update_time': 1774861522.765001}
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DH32592') HTTP/1.1" 204 0
2026-03-30 09:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e80688a-e5dc-5846-8742-ff9f1d04ed9d with identifier: KJ37946
2026-03-30 09:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e80688a-e5dc-5846-8742-ff9f1d04ed9d with scrape type 1
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2e80688a-e5dc-5846-8742-ff9f1d04ed9d
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e25644cab324f4d457d5d824b20fd%252Fpa%252FKJ37946_9fb781f52ad299484a7b54ced16ffaaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_9fb781f52ad299484a7b54ced16ffaaa.jpg already downloaded
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e25644cab324f4d457d5d824b20fd%252Fpa%252FKJ37946_c3522387df3eb859846d18dd88b5663a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_c3522387df3eb859846d18dd88b5663a.jpg already downloaded
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e25644cab324f4d457d5d824b20fd%252Fpa%252FKJ37946_13a9c2c9473ce08d07cc96e0d1cee79d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_13a9c2c9473ce08d07cc96e0d1cee79d.jpg already downloaded
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e25644cab324f4d457d5d824b20fd%252Fpa%252FKJ37946_77947061d176756509eaaf5f96ede639.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_77947061d176756509eaaf5f96ede639.jpg already downloaded
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e25644cab324f4d457d5d824b20fd%252Fpa%252FKJ37946_d4e8cd075fe026f8ee8790207146f5f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_d4e8cd075fe026f8ee8790207146f5f3.jpg already downloaded
2026-03-30 09:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e80688a-e5dc-5846-8742-ff9f1d04ed9d, identifier: KJ37946
2026-03-30 09:05:22 [auto1.it] INFO: Found listing with ID: RD99785
2026-03-30 09:05:22 [auto1.it] INFO: Found listing with ID: ER70142
2026-03-30 09:05:22 [auto1.it] INFO: Found listing with ID: XW57300
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW57300%27 HTTP/1.1" 200 None
2026-03-30 09:05:23 [auto1.it] INFO: Scrape type for XW57300: 1
2026-03-30 09:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e80688a-e5dc-5846-8742-ff9f1d04ed9d with identifier: KJ37946
2026-03-30 09:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e80688a-e5dc-5846-8742-ff9f1d04ed9d with identifier: KJ37946
2026-03-30 09:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e80688a-e5dc-5846-8742-ff9f1d04ed9d with identifier: KJ37946 to the API
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KJ37946>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:02:57Z',
 'fuel_type': 'diesel',
 'id': '2e80688a-e5dc-5846-8742-ff9f1d04ed9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ37946',
 'listing': 'auction',
 'location': 'IT, Modugno',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 236970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_9fb781f52ad299484a7b54ced16ffaaa.jpg',
                'https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_c3522387df3eb859846d18dd88b5663a.jpg',
                'https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_13a9c2c9473ce08d07cc96e0d1cee79d.jpg',
                'https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_77947061d176756509eaaf5f96ede639.jpg',
                'https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_d4e8cd075fe026f8ee8790207146f5f3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e80688a-e5dc-5846-8742-ff9f1d04ed9d/2e80688a-e5dc-5846-8742-ff9f1d04ed9d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_9fb781f52ad299484a7b54ced16ffaaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e80688a-e5dc-5846-8742-ff9f1d04ed9d/2e80688a-e5dc-5846-8742-ff9f1d04ed9d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_c3522387df3eb859846d18dd88b5663a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e80688a-e5dc-5846-8742-ff9f1d04ed9d/2e80688a-e5dc-5846-8742-ff9f1d04ed9d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_13a9c2c9473ce08d07cc96e0d1cee79d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e80688a-e5dc-5846-8742-ff9f1d04ed9d/2e80688a-e5dc-5846-8742-ff9f1d04ed9d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_77947061d176756509eaaf5f96ede639.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e80688a-e5dc-5846-8742-ff9f1d04ed9d/2e80688a-e5dc-5846-8742-ff9f1d04ed9d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e25644cab324f4d457d5d824b20fd/pa/KJ37946_d4e8cd075fe026f8ee8790207146f5f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 2.0 JTDM Distinctive',
 'transmission': 'automatic',
 'trim': 'Distinctive',
 'year': 2013}
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ37946%27 HTTP/1.1" 200 None
2026-03-30 09:05:23 [auto1.it] INFO: Saving data for KJ37946: {'created_time': 1774861523.425653, 'last_price_update_time': 1774861523.425663, 'auction_closing_time': 1774969377.0}
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KJ37946') HTTP/1.1" 204 0
2026-03-30 09:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME60194> (referer: https://www.auto1.com/v1/car-details-view/ME60194/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:23 [auto1.it] INFO: Found listing with ID: AR14989
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR14989%27 HTTP/1.1" 200 None
2026-03-30 09:05:23 [auto1.it] INFO: Scrape type for AR14989: 2
2026-03-30 09:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1552de29-41ce-5c37-82ff-676bb3c0d365 with identifier: AR14989
2026-03-30 09:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1552de29-41ce-5c37-82ff-676bb3c0d365 with scrape type 2
2026-03-30 09:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1552de29-41ce-5c37-82ff-676bb3c0d365 with scrape type 2
2026-03-30 09:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1552de29-41ce-5c37-82ff-676bb3c0d365, identifier: AR14989
2026-03-30 09:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL33491> (referer: https://www.auto1.com/v1/car-details-view/FL33491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1552de29-41ce-5c37-82ff-676bb3c0d365 with identifier: AR14989
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 09:05:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1552de29-41ce-5c37-82ff-676bb3c0d365 with identifier: AR14989
2026-03-30 09:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1552de29-41ce-5c37-82ff-676bb3c0d365 with identifier: AR14989 to the API
2026-03-30 09:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:18:21Z',
 'fuel_type': 'petrol',
 'id': '1552de29-41ce-5c37-82ff-676bb3c0d365',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR14989',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 41505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-15',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Competizione',
 'transmission': 'manual',
 'trim': 'Competizione',
 'year': 2022}
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR14989%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [auto1.it] INFO: Saving data for AR14989: {'auction_closing_time': 1774970301.0, 'created_time': 1774300010.709574, 'last_price_update_time': 1774861524.153015}
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR14989') HTTP/1.1" 204 0
2026-03-30 09:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM30901> (referer: https://www.auto1.com/v1/car-details-view/UM30901/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:24 [auto1.it] INFO: Found listing with ID: XY74656
2026-03-30 09:05:24 [auto1.it] INFO: Found listing with ID: XF75948
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF75948%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [auto1.it] INFO: Scrape type for XF75948: 1
2026-03-30 09:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:24 [auto1.it] INFO: Found listing with ID: BJ45035
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ45035%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [auto1.it] INFO: Scrape type for BJ45035: 1
2026-03-30 09:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US29444> (referer: https://www.auto1.com/v1/car-details-view/US29444/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR11304> (referer: https://www.auto1.com/v1/car-details-view/WR11304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3c1d810-2c68-5bf7-b92d-70654c843cdc with identifier: ME60194
2026-03-30 09:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c1d810-2c68-5bf7-b92d-70654c843cdc with scrape type 1
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e3c1d810-2c68-5bf7-b92d-70654c843cdc
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc3%252Fb1c3ec20d0aa5929b38d32cf1d334fa1%252Fpa%252FME60194_9b5e0f22ab4ba365fe7bcae612379972.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_9b5e0f22ab4ba365fe7bcae612379972.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc3%252Fb1c3ec20d0aa5929b38d32cf1d334fa1%252Fpa%252FME60194_236f0ac1305b8f2fc3418cc5c268f481.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_236f0ac1305b8f2fc3418cc5c268f481.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc3%252Fb1c3ec20d0aa5929b38d32cf1d334fa1%252Fpa%252FME60194_7f41bf3621be7b3ef83a7364ac7acf79.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_7f41bf3621be7b3ef83a7364ac7acf79.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc3%252Fb1c3ec20d0aa5929b38d32cf1d334fa1%252Fpa%252FME60194_65d8adcac1ee8d233a583063c1283d56.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_65d8adcac1ee8d233a583063c1283d56.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fc3%252Fb1c3ec20d0aa5929b38d32cf1d334fa1%252Fpa%252FME60194_50940d27eae4c770ae68d4a8db2efe77.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_50940d27eae4c770ae68d4a8db2efe77.jpg already downloaded
2026-03-30 09:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3c1d810-2c68-5bf7-b92d-70654c843cdc, identifier: ME60194
2026-03-30 09:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09422d86-166b-5150-8086-a1a3006681ea with identifier: FL33491
2026-03-30 09:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09422d86-166b-5150-8086-a1a3006681ea with scrape type 1
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09422d86-166b-5150-8086-a1a3006681ea
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7e%252F997e6572df8fcc5af56d7a713be32d69%252Fpa%252FFL33491_ca447914f53f7b5886fc64ea17233de5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_ca447914f53f7b5886fc64ea17233de5.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7e%252F997e6572df8fcc5af56d7a713be32d69%252Fpa%252FFL33491_d8c282ba5f6f946556fee3072eb795cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_d8c282ba5f6f946556fee3072eb795cf.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7e%252F997e6572df8fcc5af56d7a713be32d69%252Fpa%252FFL33491_88b5bab635a35099006b40ebd5a42a95.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_88b5bab635a35099006b40ebd5a42a95.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7e%252F997e6572df8fcc5af56d7a713be32d69%252Fpa%252FFL33491_363044ba76f85fe6ed5640e54862b622.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_363044ba76f85fe6ed5640e54862b622.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7e%252F997e6572df8fcc5af56d7a713be32d69%252Fpa%252FFL33491_9babded2f98b84e82e558d21966f1679.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_9babded2f98b84e82e558d21966f1679.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7e%252F997e6572df8fcc5af56d7a713be32d69%252Fpa%252FFL33491_b497f2cbac5f78301560b3e96c090dd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_b497f2cbac5f78301560b3e96c090dd8.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7e%252F997e6572df8fcc5af56d7a713be32d69%252Fpa%252FFL33491_f80e15ddf8935a19569a3cf07c1ae3f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_f80e15ddf8935a19569a3cf07c1ae3f2.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7e%252F997e6572df8fcc5af56d7a713be32d69%252Fpa%252FFL33491_0d2064ab5625623dc5116149dfd537aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_0d2064ab5625623dc5116149dfd537aa.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7e%252F997e6572df8fcc5af56d7a713be32d69%252Fpa%252FFL33491_652307882d6274afe9da4a4431c8c474.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_652307882d6274afe9da4a4431c8c474.jpg already downloaded
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F7e%252F997e6572df8fcc5af56d7a713be32d69%252Fpa%252FFL33491_f6e97beeaa8f20b97f3a04307fe80631.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_f6e97beeaa8f20b97f3a04307fe80631.jpg already downloaded
2026-03-30 09:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 09422d86-166b-5150-8086-a1a3006681ea, identifier: FL33491
2026-03-30 09:05:24 [auto1.it] INFO: Found listing with ID: XU90794
2026-03-30 09:05:24 [auto1.it] INFO: Found listing with ID: XZ58879
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ58879%27 HTTP/1.1" 200 None
2026-03-30 09:05:24 [auto1.it] INFO: Scrape type for XZ58879: 1
2026-03-30 09:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3c1d810-2c68-5bf7-b92d-70654c843cdc with identifier: ME60194
2026-03-30 09:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3c1d810-2c68-5bf7-b92d-70654c843cdc with identifier: ME60194
2026-03-30 09:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3c1d810-2c68-5bf7-b92d-70654c843cdc with identifier: ME60194 to the API
2026-03-30 09:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ME60194>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:25:31Z',
 'fuel_type': 'diesel',
 'id': 'e3c1d810-2c68-5bf7-b92d-70654c843cdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME60194',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 188163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_9b5e0f22ab4ba365fe7bcae612379972.jpg',
                'https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_236f0ac1305b8f2fc3418cc5c268f481.jpg',
                'https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_7f41bf3621be7b3ef83a7364ac7acf79.jpg',
                'https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_65d8adcac1ee8d233a583063c1283d56.jpg',
                'https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_50940d27eae4c770ae68d4a8db2efe77.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3c1d810-2c68-5bf7-b92d-70654c843cdc/e3c1d810-2c68-5bf7-b92d-70654c843cdc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_9b5e0f22ab4ba365fe7bcae612379972.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3c1d810-2c68-5bf7-b92d-70654c843cdc/e3c1d810-2c68-5bf7-b92d-70654c843cdc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_236f0ac1305b8f2fc3418cc5c268f481.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3c1d810-2c68-5bf7-b92d-70654c843cdc/e3c1d810-2c68-5bf7-b92d-70654c843cdc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_7f41bf3621be7b3ef83a7364ac7acf79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3c1d810-2c68-5bf7-b92d-70654c843cdc/e3c1d810-2c68-5bf7-b92d-70654c843cdc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_65d8adcac1ee8d233a583063c1283d56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3c1d810-2c68-5bf7-b92d-70654c843cdc/e3c1d810-2c68-5bf7-b92d-70654c843cdc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/c3/b1c3ec20d0aa5929b38d32cf1d334fa1/pa/ME60194_50940d27eae4c770ae68d4a8db2efe77.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2010}
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME60194%27 HTTP/1.1" 200 None
2026-03-30 09:05:25 [auto1.it] INFO: Saving data for ME60194: {'created_time': 1774861525.569662, 'last_price_update_time': 1774861525.569673, 'auction_closing_time': 1774970731.0}
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ME60194') HTTP/1.1" 204 0
2026-03-30 09:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 09422d86-166b-5150-8086-a1a3006681ea with identifier: FL33491
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 09:05:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 09422d86-166b-5150-8086-a1a3006681ea with identifier: FL33491
2026-03-30 09:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 09422d86-166b-5150-8086-a1a3006681ea with identifier: FL33491 to the API
2026-03-30 09:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FL33491>
{'auction_title': '',
 'c_o_2_emission_value': 71,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:47:11Z',
 'fuel_type': 'hybrid',
 'id': '09422d86-166b-5150-8086-a1a3006681ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL33491',
 'listing': 'auction',
 'location': 'IT',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 105951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_ca447914f53f7b5886fc64ea17233de5.jpg',
                'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_d8c282ba5f6f946556fee3072eb795cf.jpg',
                'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_88b5bab635a35099006b40ebd5a42a95.jpg',
                'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_363044ba76f85fe6ed5640e54862b622.jpg',
                'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_9babded2f98b84e82e558d21966f1679.jpg',
                'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_b497f2cbac5f78301560b3e96c090dd8.jpg',
                'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_f80e15ddf8935a19569a3cf07c1ae3f2.jpg',
                'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_0d2064ab5625623dc5116149dfd537aa.jpg',
                'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_652307882d6274afe9da4a4431c8c474.jpg',
                'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_f6e97beeaa8f20b97f3a04307fe80631.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09422d86-166b-5150-8086-a1a3006681ea/09422d86-166b-5150-8086-a1a3006681ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679732,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_ca447914f53f7b5886fc64ea17233de5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09422d86-166b-5150-8086-a1a3006681ea/09422d86-166b-5150-8086-a1a3006681ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_d8c282ba5f6f946556fee3072eb795cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09422d86-166b-5150-8086-a1a3006681ea/09422d86-166b-5150-8086-a1a3006681ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429083,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_88b5bab635a35099006b40ebd5a42a95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09422d86-166b-5150-8086-a1a3006681ea/09422d86-166b-5150-8086-a1a3006681ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_363044ba76f85fe6ed5640e54862b622.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09422d86-166b-5150-8086-a1a3006681ea/09422d86-166b-5150-8086-a1a3006681ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 691762,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_9babded2f98b84e82e558d21966f1679.jpg',
             'Width': 1943},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09422d86-166b-5150-8086-a1a3006681ea/09422d86-166b-5150-8086-a1a3006681ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_b497f2cbac5f78301560b3e96c090dd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09422d86-166b-5150-8086-a1a3006681ea/09422d86-166b-5150-8086-a1a3006681ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 598183,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_f80e15ddf8935a19569a3cf07c1ae3f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09422d86-166b-5150-8086-a1a3006681ea/09422d86-166b-5150-8086-a1a3006681ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 726312,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_0d2064ab5625623dc5116149dfd537aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09422d86-166b-5150-8086-a1a3006681ea/09422d86-166b-5150-8086-a1a3006681ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 575497,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_652307882d6274afe9da4a4431c8c474.jpg',
             'Width': 1821},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09422d86-166b-5150-8086-a1a3006681ea/09422d86-166b-5150-8086-a1a3006681ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 393513,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/7e/997e6572df8fcc5af56d7a713be32d69/pa/FL33491_f6e97beeaa8f20b97f3a04307fe80631.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2019}
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL33491%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [auto1.it] INFO: Saving data for FL33491: {'created_time': 1774861526.312606, 'last_price_update_time': 1774861526.312616, 'auction_closing_time': 1774972031.0}
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FL33491') HTTP/1.1" 204 0
2026-03-30 09:05:26 [auto1.it] INFO: Found listing with ID: PM75011
2026-03-30 09:05:26 [auto1.it] INFO: Found listing with ID: EM68882
2026-03-30 09:05:26 [auto1.it] INFO: Found listing with ID: TB20561
2026-03-30 09:05:26 [auto1.it] INFO: Found listing with ID: VJ71364
2026-03-30 09:05:26 [auto1.it] INFO: Found listing with ID: GD09579
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD09579%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [auto1.it] INFO: Scrape type for GD09579: 2
2026-03-30 09:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c3867f2-b808-5435-bcb9-b94f45a83609 with identifier: GD09579
2026-03-30 09:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c3867f2-b808-5435-bcb9-b94f45a83609 with scrape type 2
2026-03-30 09:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c3867f2-b808-5435-bcb9-b94f45a83609 with scrape type 2
2026-03-30 09:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c3867f2-b808-5435-bcb9-b94f45a83609, identifier: GD09579
2026-03-30 09:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD34465> (referer: https://www.auto1.com/v1/car-details-view/FD34465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c3867f2-b808-5435-bcb9-b94f45a83609 with identifier: GD09579
2026-03-30 09:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c3867f2-b808-5435-bcb9-b94f45a83609 with identifier: GD09579
2026-03-30 09:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c3867f2-b808-5435-bcb9-b94f45a83609 with identifier: GD09579 to the API
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:14:43Z',
 'fuel_type': 'diesel',
 'id': '8c3867f2-b808-5435-bcb9-b94f45a83609',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD09579',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 185374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-01',
 'seller_name': None,
 'title': 'BMW 1er 114d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD09579%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [auto1.it] INFO: Saving data for GD09579: {'auction_closing_time': 1774970083.0, 'created_time': 1774440492.015341, 'last_price_update_time': 1774861526.882734}
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GD09579') HTTP/1.1" 204 0
2026-03-30 09:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG14911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT31796> (referer: https://www.auto1.com/v1/car-details-view/TT31796/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbdd9bdb-94e8-5485-af5d-d10274168797 with identifier: UM30901
2026-03-30 09:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbdd9bdb-94e8-5485-af5d-d10274168797 with scrape type 1
2026-03-30 09:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbdd9bdb-94e8-5485-af5d-d10274168797
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3d%252F683debd9278f2a4f69c71a8d7446230b%252Fpa%252FUM30901_e66f9b605e5990be41a644c306ced081.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_e66f9b605e5990be41a644c306ced081.jpg already downloaded
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3d%252F683debd9278f2a4f69c71a8d7446230b%252Fpa%252FUM30901_b53d4fbb169a25cbe716e7c8d83942e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_b53d4fbb169a25cbe716e7c8d83942e2.jpg already downloaded
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3d%252F683debd9278f2a4f69c71a8d7446230b%252Fpa%252FUM30901_d6ab20f5b4391cd3248ddbdb7c4554c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_d6ab20f5b4391cd3248ddbdb7c4554c1.jpg already downloaded
2026-03-30 09:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3d%252F683debd9278f2a4f69c71a8d7446230b%252Fpa%252FUM30901_9a62b593a5910458de3906d5c4ace78a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_9a62b593a5910458de3906d5c4ace78a.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3d%252F683debd9278f2a4f69c71a8d7446230b%252Fpa%252FUM30901_8e2cc291db702200e823232395b465b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_8e2cc291db702200e823232395b465b5.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3d%252F683debd9278f2a4f69c71a8d7446230b%252Fpa%252FUM30901_6ee54a7a6639198f89e712335474b43a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_6ee54a7a6639198f89e712335474b43a.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3d%252F683debd9278f2a4f69c71a8d7446230b%252Fpa%252FUM30901_aeef0edb8624ebb9b85c383b7b5336d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_aeef0edb8624ebb9b85c383b7b5336d5.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3d%252F683debd9278f2a4f69c71a8d7446230b%252Fpa%252FUM30901_73cc65ec1db9bce2e240ec1b45c869df.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_73cc65ec1db9bce2e240ec1b45c869df.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3d%252F683debd9278f2a4f69c71a8d7446230b%252Fpa%252FUM30901_50542370cfc39f5679de7f1c7f8a5cd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_50542370cfc39f5679de7f1c7f8a5cd8.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3d%252F683debd9278f2a4f69c71a8d7446230b%252Fpa%252FUM30901_8388851964b7cb9804a4583342c98b2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_8388851964b7cb9804a4583342c98b2c.jpg already downloaded
2026-03-30 09:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dbdd9bdb-94e8-5485-af5d-d10274168797, identifier: UM30901
2026-03-30 09:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29d22aaf-4ef9-5fed-935d-8af0d20d66a3 with identifier: US29444
2026-03-30 09:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d22aaf-4ef9-5fed-935d-8af0d20d66a3 with scrape type 1
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29d22aaf-4ef9-5fed-935d-8af0d20d66a3
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F83%252F8183ee02416123008b06c5671447df25%252Fpa%252FUS29444_30346f32443c98cb85f742e78eecf6b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_30346f32443c98cb85f742e78eecf6b8.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F83%252F8183ee02416123008b06c5671447df25%252Fpa%252FUS29444_9abb02baa30409f1e51b3c587209e1b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_9abb02baa30409f1e51b3c587209e1b6.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F83%252F8183ee02416123008b06c5671447df25%252Fpa%252FUS29444_a75843a56d8b48b699b7b742758d8220.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_a75843a56d8b48b699b7b742758d8220.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F83%252F8183ee02416123008b06c5671447df25%252Fpa%252FUS29444_ecc019c256d3b93e37bd1af06eb23da3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_ecc019c256d3b93e37bd1af06eb23da3.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F83%252F8183ee02416123008b06c5671447df25%252Fpa%252FUS29444_0b9fbc396f3e90b10f98dd6075262794.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_0b9fbc396f3e90b10f98dd6075262794.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F83%252F8183ee02416123008b06c5671447df25%252Fpa%252FUS29444_32303c4c7bbb29ff7a8f06959533de46.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_32303c4c7bbb29ff7a8f06959533de46.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F83%252F8183ee02416123008b06c5671447df25%252Fpa%252FUS29444_568b3e52578a21733cb294a08b2be59b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_568b3e52578a21733cb294a08b2be59b.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F83%252F8183ee02416123008b06c5671447df25%252Fpa%252FUS29444_fc1ac7b6fc0a8606c9252d5dfc2b4183.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_fc1ac7b6fc0a8606c9252d5dfc2b4183.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F83%252F8183ee02416123008b06c5671447df25%252Fpa%252FUS29444_5d0adc72b5f2caf4c4b2cf40156f9f1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_5d0adc72b5f2caf4c4b2cf40156f9f1c.jpg already downloaded
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F83%252F8183ee02416123008b06c5671447df25%252Fpa%252FUS29444_f212a7fcd8fd59bf6b0691a954f17cba.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_f212a7fcd8fd59bf6b0691a954f17cba.jpg already downloaded
2026-03-30 09:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 29d22aaf-4ef9-5fed-935d-8af0d20d66a3, identifier: US29444
2026-03-30 09:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with identifier: WR11304
2026-03-30 09:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with scrape type 1
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_fd601fdc16f7532675122535e7ba4976.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fd601fdc16f7532675122535e7ba4976.jpg not downloaded yet
2026-03-30 09:05:27 [auto1.it] INFO: Found listing with ID: RA79730
2026-03-30 09:05:27 [auto1.it] INFO: Found listing with ID: KC51409
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC51409%27 HTTP/1.1" 200 None
2026-03-30 09:05:27 [auto1.it] INFO: Scrape type for KC51409: 2
2026-03-30 09:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78e34f57-f55d-5b73-a7ea-b7049ff7a774 with identifier: KC51409
2026-03-30 09:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78e34f57-f55d-5b73-a7ea-b7049ff7a774 with scrape type 2
2026-03-30 09:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78e34f57-f55d-5b73-a7ea-b7049ff7a774 with scrape type 2
2026-03-30 09:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 78e34f57-f55d-5b73-a7ea-b7049ff7a774, identifier: KC51409
2026-03-30 09:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dbdd9bdb-94e8-5485-af5d-d10274168797 with identifier: UM30901
2026-03-30 09:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dbdd9bdb-94e8-5485-af5d-d10274168797 with identifier: UM30901
2026-03-30 09:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dbdd9bdb-94e8-5485-af5d-d10274168797 with identifier: UM30901 to the API
2026-03-30 09:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UM30901>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.9L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:19:12Z',
 'fuel_type': 'diesel',
 'id': 'dbdd9bdb-94e8-5485-af5d-d10274168797',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM30901',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 64271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_e66f9b605e5990be41a644c306ced081.jpg',
                'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_b53d4fbb169a25cbe716e7c8d83942e2.jpg',
                'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_d6ab20f5b4391cd3248ddbdb7c4554c1.jpg',
                'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_9a62b593a5910458de3906d5c4ace78a.jpg',
                'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_8e2cc291db702200e823232395b465b5.jpg',
                'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_6ee54a7a6639198f89e712335474b43a.jpg',
                'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_aeef0edb8624ebb9b85c383b7b5336d5.jpg',
                'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_73cc65ec1db9bce2e240ec1b45c869df.jpg',
                'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_50542370cfc39f5679de7f1c7f8a5cd8.jpg',
                'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_8388851964b7cb9804a4583342c98b2c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdd9bdb-94e8-5485-af5d-d10274168797/dbdd9bdb-94e8-5485-af5d-d10274168797_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_e66f9b605e5990be41a644c306ced081.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdd9bdb-94e8-5485-af5d-d10274168797/dbdd9bdb-94e8-5485-af5d-d10274168797_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_b53d4fbb169a25cbe716e7c8d83942e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdd9bdb-94e8-5485-af5d-d10274168797/dbdd9bdb-94e8-5485-af5d-d10274168797_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_d6ab20f5b4391cd3248ddbdb7c4554c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdd9bdb-94e8-5485-af5d-d10274168797/dbdd9bdb-94e8-5485-af5d-d10274168797_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_9a62b593a5910458de3906d5c4ace78a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdd9bdb-94e8-5485-af5d-d10274168797/dbdd9bdb-94e8-5485-af5d-d10274168797_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_8e2cc291db702200e823232395b465b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdd9bdb-94e8-5485-af5d-d10274168797/dbdd9bdb-94e8-5485-af5d-d10274168797_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_6ee54a7a6639198f89e712335474b43a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdd9bdb-94e8-5485-af5d-d10274168797/dbdd9bdb-94e8-5485-af5d-d10274168797_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_aeef0edb8624ebb9b85c383b7b5336d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdd9bdb-94e8-5485-af5d-d10274168797/dbdd9bdb-94e8-5485-af5d-d10274168797_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_73cc65ec1db9bce2e240ec1b45c869df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdd9bdb-94e8-5485-af5d-d10274168797/dbdd9bdb-94e8-5485-af5d-d10274168797_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_50542370cfc39f5679de7f1c7f8a5cd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbdd9bdb-94e8-5485-af5d-d10274168797/dbdd9bdb-94e8-5485-af5d-d10274168797_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3d/683debd9278f2a4f69c71a8d7446230b/pa/UM30901_8388851964b7cb9804a4583342c98b2c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM30901%27 HTTP/1.1" 200 None
2026-03-30 09:05:28 [auto1.it] INFO: Saving data for UM30901: {'created_time': 1774861528.22365, 'last_price_update_time': 1774861528.223661, 'auction_closing_time': 1774970352.0}
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UM30901') HTTP/1.1" 204 0
2026-03-30 09:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 29d22aaf-4ef9-5fed-935d-8af0d20d66a3 with identifier: US29444
2026-03-30 09:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 29d22aaf-4ef9-5fed-935d-8af0d20d66a3 with identifier: US29444
2026-03-30 09:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 29d22aaf-4ef9-5fed-935d-8af0d20d66a3 with identifier: US29444 to the API
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/US29444>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:26:39Z',
 'fuel_type': 'diesel',
 'id': '29d22aaf-4ef9-5fed-935d-8af0d20d66a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US29444',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 202729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_30346f32443c98cb85f742e78eecf6b8.jpg',
                'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_9abb02baa30409f1e51b3c587209e1b6.jpg',
                'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_a75843a56d8b48b699b7b742758d8220.jpg',
                'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_ecc019c256d3b93e37bd1af06eb23da3.jpg',
                'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_0b9fbc396f3e90b10f98dd6075262794.jpg',
                'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_32303c4c7bbb29ff7a8f06959533de46.jpg',
                'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_568b3e52578a21733cb294a08b2be59b.jpg',
                'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_fc1ac7b6fc0a8606c9252d5dfc2b4183.jpg',
                'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_5d0adc72b5f2caf4c4b2cf40156f9f1c.jpg',
                'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_f212a7fcd8fd59bf6b0691a954f17cba.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d22aaf-4ef9-5fed-935d-8af0d20d66a3/29d22aaf-4ef9-5fed-935d-8af0d20d66a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_30346f32443c98cb85f742e78eecf6b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d22aaf-4ef9-5fed-935d-8af0d20d66a3/29d22aaf-4ef9-5fed-935d-8af0d20d66a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_9abb02baa30409f1e51b3c587209e1b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d22aaf-4ef9-5fed-935d-8af0d20d66a3/29d22aaf-4ef9-5fed-935d-8af0d20d66a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_a75843a56d8b48b699b7b742758d8220.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d22aaf-4ef9-5fed-935d-8af0d20d66a3/29d22aaf-4ef9-5fed-935d-8af0d20d66a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_ecc019c256d3b93e37bd1af06eb23da3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d22aaf-4ef9-5fed-935d-8af0d20d66a3/29d22aaf-4ef9-5fed-935d-8af0d20d66a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_0b9fbc396f3e90b10f98dd6075262794.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d22aaf-4ef9-5fed-935d-8af0d20d66a3/29d22aaf-4ef9-5fed-935d-8af0d20d66a3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_32303c4c7bbb29ff7a8f06959533de46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d22aaf-4ef9-5fed-935d-8af0d20d66a3/29d22aaf-4ef9-5fed-935d-8af0d20d66a3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_568b3e52578a21733cb294a08b2be59b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d22aaf-4ef9-5fed-935d-8af0d20d66a3/29d22aaf-4ef9-5fed-935d-8af0d20d66a3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_fc1ac7b6fc0a8606c9252d5dfc2b4183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d22aaf-4ef9-5fed-935d-8af0d20d66a3/29d22aaf-4ef9-5fed-935d-8af0d20d66a3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_5d0adc72b5f2caf4c4b2cf40156f9f1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d22aaf-4ef9-5fed-935d-8af0d20d66a3/29d22aaf-4ef9-5fed-935d-8af0d20d66a3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/83/8183ee02416123008b06c5671447df25/pa/US29444_f212a7fcd8fd59bf6b0691a954f17cba.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Koleos 2.0 dCi BOSE Edition',
 'transmission': 'automatic',
 'trim': 'BOSE Edition',
 'year': 2011}
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US29444%27 HTTP/1.1" 200 None
2026-03-30 09:05:28 [auto1.it] INFO: Saving data for US29444: {'created_time': 1774861528.62613, 'last_price_update_time': 1774861528.626142, 'auction_closing_time': 1774970799.0}
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='US29444') HTTP/1.1" 204 0
2026-03-30 09:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 78e34f57-f55d-5b73-a7ea-b7049ff7a774 with identifier: KC51409
2026-03-30 09:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 78e34f57-f55d-5b73-a7ea-b7049ff7a774 with identifier: KC51409
2026-03-30 09:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 78e34f57-f55d-5b73-a7ea-b7049ff7a774 with identifier: KC51409 to the API
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:58:06Z',
 'fuel_type': 'diesel',
 'id': '78e34f57-f55d-5b73-a7ea-b7049ff7a774',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC51409',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 221306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-15',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2011}
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC51409%27 HTTP/1.1" 200 None
2026-03-30 09:05:28 [auto1.it] INFO: Saving data for KC51409: {'auction_closing_time': 1774972686.0, 'created_time': 1774440399.311399, 'last_price_update_time': 1774861528.975628}
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC51409') HTTP/1.1" 204 0
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_5416ee22654ba5758a9235dffbb8e4d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_5416ee22654ba5758a9235dffbb8e4d3.jpg not downloaded yet
2026-03-30 09:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX59226> (referer: https://www.auto1.com/v1/car-details-view/AX59226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:29 [auto1.it] INFO: Found listing with ID: PT97539
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT97539%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [auto1.it] INFO: Scrape type for PT97539: 2
2026-03-30 09:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6fec415-2d89-570b-848c-ee5993fa901f with identifier: PT97539
2026-03-30 09:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6fec415-2d89-570b-848c-ee5993fa901f with scrape type 2
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6fec415-2d89-570b-848c-ee5993fa901f with scrape type 2
2026-03-30 09:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e6fec415-2d89-570b-848c-ee5993fa901f, identifier: PT97539
2026-03-30 09:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e60e8b2c-2ddc-5c21-8df5-23eca2c90987 with identifier: FD34465
2026-03-30 09:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e60e8b2c-2ddc-5c21-8df5-23eca2c90987 with scrape type 1
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e60e8b2c-2ddc-5c21-8df5-23eca2c90987
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5ab3fe722ec37ff8b79bc748e4bbce%252Fpa%252FFD34465_c3214bef7539559152dbeabf758ab83b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_c3214bef7539559152dbeabf758ab83b.jpg not downloaded yet
2026-03-30 09:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8513602-c95f-5916-a9c6-6b1300653209 with identifier: TT31796
2026-03-30 09:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8513602-c95f-5916-a9c6-6b1300653209 with scrape type 1
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8513602-c95f-5916-a9c6-6b1300653209
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_016271e77155e44f9a5539509d9d97b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_016271e77155e44f9a5539509d9d97b1.jpg not downloaded yet
2026-03-30 09:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e6fec415-2d89-570b-848c-ee5993fa901f with identifier: PT97539
2026-03-30 09:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e6fec415-2d89-570b-848c-ee5993fa901f with identifier: PT97539
2026-03-30 09:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e6fec415-2d89-570b-848c-ee5993fa901f with identifier: PT97539 to the API
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:01:06Z',
 'fuel_type': 'petrol',
 'id': 'e6fec415-2d89-570b-848c-ee5993fa901f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT97539',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 127759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2022}
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT97539%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [auto1.it] INFO: Saving data for PT97539: {'auction_closing_time': 1774969266.0, 'created_time': 1774354074.068726, 'last_price_update_time': 1774861529.502168}
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PT97539') HTTP/1.1" 204 0
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_b4b28c4786c55e8ee3fa5ccb3f8a8b76.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_b4b28c4786c55e8ee3fa5ccb3f8a8b76.jpg not downloaded yet
2026-03-30 09:05:29 [auto1.it] INFO: Found listing with ID: BT13926
2026-03-30 09:05:29 [auto1.it] INFO: Found listing with ID: TF50576
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF50576%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [auto1.it] INFO: Scrape type for TF50576: 2
2026-03-30 09:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af8cd2d3-9835-5121-8c55-81d6e059549a with identifier: TF50576
2026-03-30 09:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8cd2d3-9835-5121-8c55-81d6e059549a with scrape type 2
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af8cd2d3-9835-5121-8c55-81d6e059549a with scrape type 2
2026-03-30 09:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af8cd2d3-9835-5121-8c55-81d6e059549a, identifier: TF50576
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5ab3fe722ec37ff8b79bc748e4bbce%252Fpa%252FFD34465_04b914f1565507f088c49019fe4ad838.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_04b914f1565507f088c49019fe4ad838.jpg not downloaded yet
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_787328264bd7713a65801f13a32358f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_787328264bd7713a65801f13a32358f7.jpg not downloaded yet
2026-03-30 09:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af8cd2d3-9835-5121-8c55-81d6e059549a with identifier: TF50576
2026-03-30 09:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af8cd2d3-9835-5121-8c55-81d6e059549a with identifier: TF50576
2026-03-30 09:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af8cd2d3-9835-5121-8c55-81d6e059549a with identifier: TF50576 to the API
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:54:50Z',
 'fuel_type': 'petrol',
 'id': 'af8cd2d3-9835-5121-8c55-81d6e059549a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF50576',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 118747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-15',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 T-GDI Mild-Hybrid XTech 2WD',
 'transmission': 'manual',
 'trim': 'XTech 2WD',
 'year': 2022}
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF50576%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [auto1.it] INFO: Saving data for TF50576: {'auction_closing_time': 1774972490.0, 'created_time': 1774354144.263765, 'last_price_update_time': 1774861530.09918}
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TF50576') HTTP/1.1" 204 0
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_a1f15c9f27e0a484ac53af197eb68df1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_a1f15c9f27e0a484ac53af197eb68df1.jpg not downloaded yet
2026-03-30 09:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1 with identifier: AX59226
2026-03-30 09:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1 with scrape type 1
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_956d5bc12cef9d02164d1b1b70661fcf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_956d5bc12cef9d02164d1b1b70661fcf.jpg not downloaded yet
2026-03-30 09:05:30 [auto1.it] INFO: Found listing with ID: YW32826
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW32826%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [auto1.it] INFO: Scrape type for YW32826: 1
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5ab3fe722ec37ff8b79bc748e4bbce%252Fpa%252FFD34465_dbb661579cc2d931f568090eff81afbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_dbb661579cc2d931f568090eff81afbc.jpg not downloaded yet
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_b225242088316a5463d34a78ba0fb81f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_b225242088316a5463d34a78ba0fb81f.jpg not downloaded yet
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_fc3dcb4b993cbd7a7725571f23231f2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fc3dcb4b993cbd7a7725571f23231f2b.jpg not downloaded yet
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_7eea9d4341d0e6aac73890918272bed1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_7eea9d4341d0e6aac73890918272bed1.jpg not downloaded yet
2026-03-30 09:05:30 [auto1.it] INFO: Found listing with ID: AD37859
2026-03-30 09:05:30 [auto1.it] INFO: Found listing with ID: DR91409
2026-03-30 09:05:30 [auto1.it] INFO: Found listing with ID: TW08146
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW08146%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [auto1.it] INFO: Scrape type for TW08146: 2
2026-03-30 09:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7cb201d-0e91-57e5-963f-85095412c00f with identifier: TW08146
2026-03-30 09:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7cb201d-0e91-57e5-963f-85095412c00f with scrape type 2
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7cb201d-0e91-57e5-963f-85095412c00f with scrape type 2
2026-03-30 09:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a7cb201d-0e91-57e5-963f-85095412c00f, identifier: TW08146
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5ab3fe722ec37ff8b79bc748e4bbce%252Fpa%252FFD34465_9feb29b715798457fb1be5fd3e6f2068.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_9feb29b715798457fb1be5fd3e6f2068.jpg not downloaded yet
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_e8d7e8ffc12226e8cffc5883a9176e34.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_e8d7e8ffc12226e8cffc5883a9176e34.jpg not downloaded yet
2026-03-30 09:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU79948> (referer: https://www.auto1.com/v1/car-details-view/LU79948/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XW57300/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE55606> (referer: https://www.auto1.com/v1/car-details-view/SE55606/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a7cb201d-0e91-57e5-963f-85095412c00f with identifier: TW08146
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 09:05:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a7cb201d-0e91-57e5-963f-85095412c00f with identifier: TW08146
2026-03-30 09:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a7cb201d-0e91-57e5-963f-85095412c00f with identifier: TW08146 to the API
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:35:35Z',
 'fuel_type': 'diesel',
 'id': 'a7cb201d-0e91-57e5-963f-85095412c00f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW08146',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 131595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-04',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Prestige 4x4',
 'transmission': 'manual',
 'trim': 'Prestige 4x4',
 'year': 2018}
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW08146%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [auto1.it] INFO: Saving data for TW08146: {'auction_closing_time': 1774971335.0, 'created_time': 1773129517.159748, 'last_price_update_time': 1774861531.412004}
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TW08146') HTTP/1.1" 204 0
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_00df067aef858d5f609409bd6598e1a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_00df067aef858d5f609409bd6598e1a6.jpg not downloaded yet
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_68cecabe5f1de07df450932f70abfac9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_68cecabe5f1de07df450932f70abfac9.jpg not downloaded yet
2026-03-30 09:05:31 [auto1.it] INFO: Found listing with ID: BP95163
2026-03-30 09:05:31 [auto1.it] INFO: Found listing with ID: JV33372
2026-03-30 09:05:31 [auto1.it] INFO: Found listing with ID: UZ43487
2026-03-30 09:05:31 [auto1.it] INFO: Found listing with ID: JL77686
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL77686%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [auto1.it] INFO: Scrape type for JL77686: 1
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5ab3fe722ec37ff8b79bc748e4bbce%252Fpa%252FFD34465_956210d09addecacee8e76e6c16b69c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_956210d09addecacee8e76e6c16b69c2.jpg not downloaded yet
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_59586913942965f1f1900df91f30fcae.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_59586913942965f1f1900df91f30fcae.jpg not downloaded yet
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_1b92cc4bb7073f64caa86851198af20c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_1b92cc4bb7073f64caa86851198af20c.jpg not downloaded yet
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_3d865a26722c4203b111ad8040e9501c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_3d865a26722c4203b111ad8040e9501c.jpg not downloaded yet
2026-03-30 09:05:31 [auto1.it] INFO: Found listing with ID: AK61800
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK61800%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [auto1.it] INFO: Scrape type for AK61800: 2
2026-03-30 09:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c732b7fc-3ced-50ec-aca7-66199b3095ef with identifier: AK61800
2026-03-30 09:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c732b7fc-3ced-50ec-aca7-66199b3095ef with scrape type 2
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c732b7fc-3ced-50ec-aca7-66199b3095ef with scrape type 2
2026-03-30 09:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c732b7fc-3ced-50ec-aca7-66199b3095ef, identifier: AK61800
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_6c83138e5e98192eb039417032c7aaf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_6c83138e5e98192eb039417032c7aaf3.jpg not downloaded yet
2026-03-30 09:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ45035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ58879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF75948/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:31 [auto1.it] INFO: Channel: 24h | Page: 3 | totalHits: 3303 | hits on page: 40
2026-03-30 09:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8f0a463-597b-52a6-bc4f-bd27dee6dd93 with identifier: LU79948
2026-03-30 09:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8f0a463-597b-52a6-bc4f-bd27dee6dd93 with scrape type 1
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a8f0a463-597b-52a6-bc4f-bd27dee6dd93
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fef%252F73ef2856247e87792dc568905ac327e4%252Fpa%252FLU79948_6b21e84042d60edce5097baa97e929aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_6b21e84042d60edce5097baa97e929aa.jpg not downloaded yet
2026-03-30 09:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6272d7c5-299a-5de7-be43-71c33c5b12c3 with identifier: SE55606
2026-03-30 09:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6272d7c5-299a-5de7-be43-71c33c5b12c3 with scrape type 1
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6272d7c5-299a-5de7-be43-71c33c5b12c3
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_44b06042015f989a743d2f7479723fef.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_44b06042015f989a743d2f7479723fef.jpg not downloaded yet
2026-03-30 09:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c732b7fc-3ced-50ec-aca7-66199b3095ef with identifier: AK61800
2026-03-30 09:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c732b7fc-3ced-50ec-aca7-66199b3095ef with identifier: AK61800
2026-03-30 09:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c732b7fc-3ced-50ec-aca7-66199b3095ef with identifier: AK61800 to the API
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:26:57Z',
 'fuel_type': 'diesel',
 'id': 'c732b7fc-3ced-50ec-aca7-66199b3095ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK61800',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 201211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-18',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2011}
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK61800%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [auto1.it] INFO: Saving data for AK61800: {'auction_closing_time': 1774970817.0, 'created_time': 1773132011.527575, 'last_price_update_time': 1774861532.372613}
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK61800') HTTP/1.1" 204 0
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_f793f1d9f08f92e3d87e5af6c0faa8e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_f793f1d9f08f92e3d87e5af6c0faa8e9.jpg not downloaded yet
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_8f1f341ffb85a62b3fe011ad1643db8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_8f1f341ffb85a62b3fe011ad1643db8e.jpg not downloaded yet
2026-03-30 09:05:32 [auto1.it] INFO: Found listing with ID: UG78231
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UG78231%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [auto1.it] INFO: Scrape type for UG78231: 1
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_3621977bad8ee073e8f76fad982060f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_3621977bad8ee073e8f76fad982060f8.jpg not downloaded yet
2026-03-30 09:05:32 [auto1.it] INFO: Found listing with ID: RC63187
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC63187%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [auto1.it] INFO: Scrape type for RC63187: 1
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fef%252F73ef2856247e87792dc568905ac327e4%252Fpa%252FLU79948_c144b91af445a453b2cd1ad27b1e43b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_c144b91af445a453b2cd1ad27b1e43b9.jpg not downloaded yet
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_0601a884f36414c09b06e534aba7c7af.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_0601a884f36414c09b06e534aba7c7af.jpg not downloaded yet
2026-03-30 09:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_774e36b5a1ef9c2d6275ae193fc1ad8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_774e36b5a1ef9c2d6275ae193fc1ad8b.jpg not downloaded yet
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_3d8e4c215ed3521dc725e51e23295203.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_3d8e4c215ed3521dc725e51e23295203.jpg not downloaded yet
2026-03-30 09:05:32 [auto1.it] INFO: Found listing with ID: XR95165
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR95165%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [auto1.it] INFO: Scrape type for XR95165: 1
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_22d401e1acfe3bbf62fdf6d96a85322e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_22d401e1acfe3bbf62fdf6d96a85322e.jpg not downloaded yet
2026-03-30 09:05:32 [auto1.it] INFO: Found listing with ID: CZ89669
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ89669%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [auto1.it] INFO: Scrape type for CZ89669: 1
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fef%252F73ef2856247e87792dc568905ac327e4%252Fpa%252FLU79948_df344cf59b1d93558d7b847153b60c53.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_df344cf59b1d93558d7b847153b60c53.jpg not downloaded yet
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_576dadb994b4338c8e6fc8f41ff539ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_576dadb994b4338c8e6fc8f41ff539ba.jpg not downloaded yet
2026-03-30 09:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_b4b28c4786c55e8ee3fa5ccb3f8a8b76.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fd601fdc16f7532675122535e7ba4976.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_89acf8fc33056768cc57993ad2cb56e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_89acf8fc33056768cc57993ad2cb56e2.jpg not downloaded yet
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_7fb85def24f60fb90ddb7e810c7934bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_7fb85def24f60fb90ddb7e810c7934bd.jpg not downloaded yet
2026-03-30 09:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_5416ee22654ba5758a9235dffbb8e4d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:32 [auto1.it] INFO: Found listing with ID: PU84761
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU84761%27 HTTP/1.1" 200 None
2026-03-30 09:05:32 [auto1.it] INFO: Scrape type for PU84761: 1
2026-03-30 09:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_68ee6a4edcd49c57abf4ce083f31d8d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_68ee6a4edcd49c57abf4ce083f31d8d1.jpg not downloaded yet
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: ZD15885
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: SR04366
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: EL85999
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL85999%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [auto1.it] INFO: Scrape type for EL85999: 1
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fef%252F73ef2856247e87792dc568905ac327e4%252Fpa%252FLU79948_e699343e3bdf3b16a498a232563dbfd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_e699343e3bdf3b16a498a232563dbfd9.jpg not downloaded yet
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_2bfb089509e36bb8edd2bb299258f227.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_2bfb089509e36bb8edd2bb299258f227.jpg not downloaded yet
2026-03-30 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_956d5bc12cef9d02164d1b1b70661fcf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_787328264bd7713a65801f13a32358f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_c3214bef7539559152dbeabf758ab83b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_04b914f1565507f088c49019fe4ad838.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_016271e77155e44f9a5539509d9d97b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_39ee4ef072b1e039827e8c925cad57eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_39ee4ef072b1e039827e8c925cad57eb.jpg not downloaded yet
2026-03-30 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_e8d7e8ffc12226e8cffc5883a9176e34.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: WR13144
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR13144%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [auto1.it] INFO: Scrape type for WR13144: 1
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_47af5056d755d4be911e3265b7013a62.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_47af5056d755d4be911e3265b7013a62.jpg not downloaded yet
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: BE54405
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: FG27064
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG27064%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [auto1.it] INFO: Scrape type for FG27064: 1
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fef%252F73ef2856247e87792dc568905ac327e4%252Fpa%252FLU79948_d18433039f5ecf1ac1862d84d898d917.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_d18433039f5ecf1ac1862d84d898d917.jpg not downloaded yet
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_2484b19eb9805fa727d826f8510d8bc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_2484b19eb9805fa727d826f8510d8bc0.jpg not downloaded yet
2026-03-30 09:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1374ed0>
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_b4b28c4786c55e8ee3fa5ccb3f8a8b76.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_b4b28c4786c55e8ee3fa5ccb3f8a8b76.jpg saved to cache
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1424450>
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_fd601fdc16f7532675122535e7ba4976.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fd601fdc16f7532675122535e7ba4976.jpg saved to cache
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-03-30 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_9feb29b715798457fb1be5fd3e6f2068.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_30ea97c8334e4cd2e9bdc7c2d1386f68.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_30ea97c8334e4cd2e9bdc7c2d1386f68.jpg not downloaded yet
2026-03-30 09:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_7eea9d4341d0e6aac73890918272bed1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: KA38100
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA38100%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [auto1.it] INFO: Scrape type for KA38100: 1
2026-03-30 09:05:33 [auto1.it] INFO: Found listing with ID: UN22377
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN22377%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [auto1.it] INFO: Scrape type for UN22377: 2
2026-03-30 09:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ce46289-eec0-5379-9f02-76b073bec34c with identifier: UN22377
2026-03-30 09:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce46289-eec0-5379-9f02-76b073bec34c with scrape type 2
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ce46289-eec0-5379-9f02-76b073bec34c with scrape type 2
2026-03-30 09:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ce46289-eec0-5379-9f02-76b073bec34c, identifier: UN22377
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_cc50a6599404948e4ac33d5341776037.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_cc50a6599404948e4ac33d5341776037.jpg not downloaded yet
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1365410>
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_5416ee22654ba5758a9235dffbb8e4d3.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_5416ee22654ba5758a9235dffbb8e4d3.jpg saved to cache
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_fd02a2aec009a614dd1a0bf7df5c8822.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_fd02a2aec009a614dd1a0bf7df5c8822.jpg not downloaded yet
2026-03-30 09:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ce46289-eec0-5379-9f02-76b073bec34c with identifier: UN22377
2026-03-30 09:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ce46289-eec0-5379-9f02-76b073bec34c with identifier: UN22377
2026-03-30 09:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ce46289-eec0-5379-9f02-76b073bec34c with identifier: UN22377 to the API
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:15:53Z',
 'fuel_type': 'diesel',
 'id': '6ce46289-eec0-5379-9f02-76b073bec34c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN22377',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 282466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-23',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Easy Business',
 'transmission': 'manual',
 'trim': 'Easy Business',
 'year': 2016}
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN22377%27 HTTP/1.1" 200 None
2026-03-30 09:05:34 [auto1.it] INFO: Saving data for UN22377: {'auction_closing_time': 1774970153.0, 'created_time': 1774300203.74043, 'last_price_update_time': 1774861534.273821}
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UN22377') HTTP/1.1" 204 0
2026-03-30 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_576dadb994b4338c8e6fc8f41ff539ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fc3dcb4b993cbd7a7725571f23231f2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_774e36b5a1ef9c2d6275ae193fc1ad8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_3d8e4c215ed3521dc725e51e23295203.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:34 [auto1.it] INFO: Found listing with ID: HL94253
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL94253%27 HTTP/1.1" 200 None
2026-03-30 09:05:34 [auto1.it] INFO: Scrape type for HL94253: 1
2026-03-30 09:05:34 [auto1.it] INFO: Found listing with ID: YN38786
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN38786%27 HTTP/1.1" 200 None
2026-03-30 09:05:34 [auto1.it] INFO: Scrape type for YN38786: 1
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_bf35faa0dc4b8fb22dc23192486a825d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_bf35faa0dc4b8fb22dc23192486a825d.jpg not downloaded yet
2026-03-30 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_2bfb089509e36bb8edd2bb299258f227.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_e699343e3bdf3b16a498a232563dbfd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_44b06042015f989a743d2f7479723fef.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_6b21e84042d60edce5097baa97e929aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG14911> (referer: https://www.auto1.com/v1/car-details-view/EG14911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1324ad0>
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_956d5bc12cef9d02164d1b1b70661fcf.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_956d5bc12cef9d02164d1b1b70661fcf.jpg saved to cache
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2740a10>
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_787328264bd7713a65801f13a32358f7.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_787328264bd7713a65801f13a32358f7.jpg saved to cache
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8513602-c95f-5916-a9c6-6b1300653209
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12e9510>
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e60e8b2c-2ddc-5c21-8df5-23eca2c90987/e60e8b2c-2ddc-5c21-8df5-23eca2c90987_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5ab3fe722ec37ff8b79bc748e4bbce%252Fpa%252FFD34465_c3214bef7539559152dbeabf758ab83b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_c3214bef7539559152dbeabf758ab83b.jpg saved to cache
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e60e8b2c-2ddc-5c21-8df5-23eca2c90987
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11a8d10>
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e60e8b2c-2ddc-5c21-8df5-23eca2c90987/e60e8b2c-2ddc-5c21-8df5-23eca2c90987_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5ab3fe722ec37ff8b79bc748e4bbce%252Fpa%252FFD34465_04b914f1565507f088c49019fe4ad838.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_04b914f1565507f088c49019fe4ad838.jpg saved to cache
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e60e8b2c-2ddc-5c21-8df5-23eca2c90987
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13824d0>
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_016271e77155e44f9a5539509d9d97b1.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_016271e77155e44f9a5539509d9d97b1.jpg saved to cache
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8513602-c95f-5916-a9c6-6b1300653209
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1375390>
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_e8d7e8ffc12226e8cffc5883a9176e34.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_e8d7e8ffc12226e8cffc5883a9176e34.jpg saved to cache
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8513602-c95f-5916-a9c6-6b1300653209
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25ea950>
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e60e8b2c-2ddc-5c21-8df5-23eca2c90987/e60e8b2c-2ddc-5c21-8df5-23eca2c90987_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5ab3fe722ec37ff8b79bc748e4bbce%252Fpa%252FFD34465_9feb29b715798457fb1be5fd3e6f2068.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_9feb29b715798457fb1be5fd3e6f2068.jpg saved to cache
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e60e8b2c-2ddc-5c21-8df5-23eca2c90987
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11a8350>
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_7eea9d4341d0e6aac73890918272bed1.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_7eea9d4341d0e6aac73890918272bed1.jpg saved to cache
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1
2026-03-30 09:05:34 [auto1.it] INFO: Found listing with ID: MC43872
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC43872%27 HTTP/1.1" 200 None
2026-03-30 09:05:34 [auto1.it] INFO: Scrape type for MC43872: 1
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_3e0e707ac2f5dad97f2b007db0c7319e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_3e0e707ac2f5dad97f2b007db0c7319e.jpg not downloaded yet
2026-03-30 09:05:34 [auto1.it] INFO: Found listing with ID: WY72702
2026-03-30 09:05:34 [auto1.it] INFO: Found listing with ID: TX80167
2026-03-30 09:05:34 [auto1.it] INFO: Found listing with ID: DP93203
2026-03-30 09:05:34 [auto1.it] INFO: Found listing with ID: YR35596
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR35596%27 HTTP/1.1" 200 None
2026-03-30 09:05:34 [auto1.it] INFO: Scrape type for YR35596: 1
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_073c298e696d1042e52355e962617032.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_073c298e696d1042e52355e962617032.jpg not downloaded yet
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2630f50>
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_576dadb994b4338c8e6fc8f41ff539ba.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_576dadb994b4338c8e6fc8f41ff539ba.jpg saved to cache
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6272d7c5-299a-5de7-be43-71c33c5b12c3
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2622a10>
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_fc3dcb4b993cbd7a7725571f23231f2b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fc3dcb4b993cbd7a7725571f23231f2b.jpg saved to cache
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1487110>
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_774e36b5a1ef9c2d6275ae193fc1ad8b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_774e36b5a1ef9c2d6275ae193fc1ad8b.jpg saved to cache
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2638f90>
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_3d8e4c215ed3521dc725e51e23295203.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_3d8e4c215ed3521dc725e51e23295203.jpg saved to cache
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1411590>
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_2bfb089509e36bb8edd2bb299258f227.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_2bfb089509e36bb8edd2bb299258f227.jpg saved to cache
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6272d7c5-299a-5de7-be43-71c33c5b12c3
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2636410>
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8f0a463-597b-52a6-bc4f-bd27dee6dd93/a8f0a463-597b-52a6-bc4f-bd27dee6dd93_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fef%252F73ef2856247e87792dc568905ac327e4%252Fpa%252FLU79948_e699343e3bdf3b16a498a232563dbfd9.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_e699343e3bdf3b16a498a232563dbfd9.jpg saved to cache
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8f0a463-597b-52a6-bc4f-bd27dee6dd93
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1486810>
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_44b06042015f989a743d2f7479723fef.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_44b06042015f989a743d2f7479723fef.jpg saved to cache
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6272d7c5-299a-5de7-be43-71c33c5b12c3
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee263a890>
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8f0a463-597b-52a6-bc4f-bd27dee6dd93/a8f0a463-597b-52a6-bc4f-bd27dee6dd93_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fef%252F73ef2856247e87792dc568905ac327e4%252Fpa%252FLU79948_6b21e84042d60edce5097baa97e929aa.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_6b21e84042d60edce5097baa97e929aa.jpg saved to cache
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8f0a463-597b-52a6-bc4f-bd27dee6dd93
2026-03-30 09:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 169516d6-849a-5c59-924c-d0787217129d with identifier: EG14911
2026-03-30 09:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 169516d6-849a-5c59-924c-d0787217129d with scrape type 1
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 169516d6-849a-5c59-924c-d0787217129d
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F32%252F83329c5f68cc95d758ef27eef7d52534%252Fpa%252FEG14911_ce29c7ad52f5676ec018af18b3013578.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_ce29c7ad52f5676ec018af18b3013578.jpg already downloaded
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F32%252F83329c5f68cc95d758ef27eef7d52534%252Fpa%252FEG14911_4329551a1b2622888470efbf6083a506.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_4329551a1b2622888470efbf6083a506.jpg already downloaded
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F32%252F83329c5f68cc95d758ef27eef7d52534%252Fpa%252FEG14911_4a90224604e10b4a8e283d40852d349a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_4a90224604e10b4a8e283d40852d349a.jpg already downloaded
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F32%252F83329c5f68cc95d758ef27eef7d52534%252Fpa%252FEG14911_78d735382e023d56a6fb53f9511f2c51.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_78d735382e023d56a6fb53f9511f2c51.jpg already downloaded
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F32%252F83329c5f68cc95d758ef27eef7d52534%252Fpa%252FEG14911_f637291ef9650ebcc34d3a7dbd255ed4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_f637291ef9650ebcc34d3a7dbd255ed4.jpg already downloaded
2026-03-30 09:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 169516d6-849a-5c59-924c-d0787217129d, identifier: EG14911
2026-03-30 09:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_68ee6a4edcd49c57abf4ce083f31d8d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 169516d6-849a-5c59-924c-d0787217129d with identifier: EG14911
2026-03-30 09:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 169516d6-849a-5c59-924c-d0787217129d with identifier: EG14911
2026-03-30 09:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 169516d6-849a-5c59-924c-d0787217129d with identifier: EG14911 to the API
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EG14911>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:50:50Z',
 'fuel_type': 'petrol',
 'id': '169516d6-849a-5c59-924c-d0787217129d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG14911',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 192615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_ce29c7ad52f5676ec018af18b3013578.jpg',
                'https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_4329551a1b2622888470efbf6083a506.jpg',
                'https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_4a90224604e10b4a8e283d40852d349a.jpg',
                'https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_78d735382e023d56a6fb53f9511f2c51.jpg',
                'https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_f637291ef9650ebcc34d3a7dbd255ed4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169516d6-849a-5c59-924c-d0787217129d/169516d6-849a-5c59-924c-d0787217129d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_ce29c7ad52f5676ec018af18b3013578.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169516d6-849a-5c59-924c-d0787217129d/169516d6-849a-5c59-924c-d0787217129d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_4329551a1b2622888470efbf6083a506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169516d6-849a-5c59-924c-d0787217129d/169516d6-849a-5c59-924c-d0787217129d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_4a90224604e10b4a8e283d40852d349a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169516d6-849a-5c59-924c-d0787217129d/169516d6-849a-5c59-924c-d0787217129d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_78d735382e023d56a6fb53f9511f2c51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_169516d6-849a-5c59-924c-d0787217129d/169516d6-849a-5c59-924c-d0787217129d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/32/83329c5f68cc95d758ef27eef7d52534/pa/EG14911_f637291ef9650ebcc34d3a7dbd255ed4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Agila 1.0 Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2015}
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG14911%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [auto1.it] INFO: Saving data for EG14911: {'created_time': 1774861536.049025, 'last_price_update_time': 1774861536.049037, 'auction_closing_time': 1774972250.0}
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG14911') HTTP/1.1" 204 0
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_47af5056d755d4be911e3265b7013a62.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_cc50a6599404948e4ac33d5341776037.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_fd02a2aec009a614dd1a0bf7df5c8822.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_39ee4ef072b1e039827e8c925cad57eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_30ea97c8334e4cd2e9bdc7c2d1386f68.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: XA12696
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: NS88104
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS88104%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [auto1.it] INFO: Scrape type for NS88104: 1
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_c5a202f28aa0a5f1a8372770323ed85b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_c5a202f28aa0a5f1a8372770323ed85b.jpg not downloaded yet
2026-03-30 09:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_d18433039f5ecf1ac1862d84d898d917.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_2484b19eb9805fa727d826f8510d8bc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL85999/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF75948> (referer: https://www.auto1.com/v1/car-details-view/XF75948/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU84761/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XW57300> (referer: https://www.auto1.com/v1/car-details-view/XW57300/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: FL65861
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: VV86242
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: XJ13017
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ13017%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [auto1.it] INFO: Scrape type for XJ13017: 1
2026-03-30 09:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1224a90>
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_68ee6a4edcd49c57abf4ce083f31d8d1.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_68ee6a4edcd49c57abf4ce083f31d8d1.jpg saved to cache
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8513602-c95f-5916-a9c6-6b1300653209
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: WJ94048
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: ZF45749
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF45749%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [auto1.it] INFO: Scrape type for ZF45749: 1
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: HT40305
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT40305%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [auto1.it] INFO: Scrape type for HT40305: 1
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1086550>
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_47af5056d755d4be911e3265b7013a62.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_47af5056d755d4be911e3265b7013a62.jpg saved to cache
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8513602-c95f-5916-a9c6-6b1300653209
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2539750>
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_cc50a6599404948e4ac33d5341776037.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_cc50a6599404948e4ac33d5341776037.jpg saved to cache
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6272d7c5-299a-5de7-be43-71c33c5b12c3
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee262d1d0>
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_fd02a2aec009a614dd1a0bf7df5c8822.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_fd02a2aec009a614dd1a0bf7df5c8822.jpg saved to cache
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2545dd0>
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_39ee4ef072b1e039827e8c925cad57eb.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_39ee4ef072b1e039827e8c925cad57eb.jpg saved to cache
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12f9cd0>
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_30ea97c8334e4cd2e9bdc7c2d1386f68.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_30ea97c8334e4cd2e9bdc7c2d1386f68.jpg saved to cache
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_3e0e707ac2f5dad97f2b007db0c7319e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_bf35faa0dc4b8fb22dc23192486a825d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_073c298e696d1042e52355e962617032.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_89acf8fc33056768cc57993ad2cb56e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_7fb85def24f60fb90ddb7e810c7934bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: GS61581
2026-03-30 09:05:36 [auto1.it] INFO: Found listing with ID: XR52700
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR52700%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [auto1.it] INFO: Scrape type for XR52700: 1
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee137ec10>
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8f0a463-597b-52a6-bc4f-bd27dee6dd93/a8f0a463-597b-52a6-bc4f-bd27dee6dd93_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fef%252F73ef2856247e87792dc568905ac327e4%252Fpa%252FLU79948_d18433039f5ecf1ac1862d84d898d917.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_d18433039f5ecf1ac1862d84d898d917.jpg saved to cache
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8f0a463-597b-52a6-bc4f-bd27dee6dd93
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11863d0>
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_2484b19eb9805fa727d826f8510d8bc0.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_2484b19eb9805fa727d826f8510d8bc0.jpg saved to cache
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6272d7c5-299a-5de7-be43-71c33c5b12c3
2026-03-30 09:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80c14ac4-5e9c-5760-8822-17e1f69529fc with identifier: XF75948
2026-03-30 09:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80c14ac4-5e9c-5760-8822-17e1f69529fc with scrape type 1
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80c14ac4-5e9c-5760-8822-17e1f69529fc
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffd%252Fdefd5e13bd64fa6493a8f5afdc9bf093%252Fpa%252FXF75948_13ef1d7299e2fd9a13c6741553007ccc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_13ef1d7299e2fd9a13c6741553007ccc.jpg already downloaded
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffd%252Fdefd5e13bd64fa6493a8f5afdc9bf093%252Fpa%252FXF75948_9cfd6ac20894750f4cad4ed7774b7447.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_9cfd6ac20894750f4cad4ed7774b7447.jpg already downloaded
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffd%252Fdefd5e13bd64fa6493a8f5afdc9bf093%252Fpa%252FXF75948_7a9246a4553c4845c1865a5f260b7269.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_7a9246a4553c4845c1865a5f260b7269.jpg already downloaded
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffd%252Fdefd5e13bd64fa6493a8f5afdc9bf093%252Fpa%252FXF75948_a53433a91e4525a7a8ae4f7ee88a9605.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_a53433a91e4525a7a8ae4f7ee88a9605.jpg already downloaded
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffd%252Fdefd5e13bd64fa6493a8f5afdc9bf093%252Fpa%252FXF75948_36a87112a0ad1e474dcfce607c0fdeb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_36a87112a0ad1e474dcfce607c0fdeb3.jpg already downloaded
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffd%252Fdefd5e13bd64fa6493a8f5afdc9bf093%252Fpa%252FXF75948_e73624d04cdf7f794c5c19f39708dc2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_e73624d04cdf7f794c5c19f39708dc2d.jpg already downloaded
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffd%252Fdefd5e13bd64fa6493a8f5afdc9bf093%252Fpa%252FXF75948_c52af7cf07b503a82e0f6f5e49233c99.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_c52af7cf07b503a82e0f6f5e49233c99.jpg already downloaded
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffd%252Fdefd5e13bd64fa6493a8f5afdc9bf093%252Fpa%252FXF75948_3f8c495a4ee1ffe6ad6103eae5883d88.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_3f8c495a4ee1ffe6ad6103eae5883d88.jpg already downloaded
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffd%252Fdefd5e13bd64fa6493a8f5afdc9bf093%252Fpa%252FXF75948_20f131036885bd547c1fd8c1e310a7d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_20f131036885bd547c1fd8c1e310a7d0.jpg already downloaded
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffd%252Fdefd5e13bd64fa6493a8f5afdc9bf093%252Fpa%252FXF75948_839dfb0357e479f9f24ca70551aa023f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_839dfb0357e479f9f24ca70551aa023f.jpg already downloaded
2026-03-30 09:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 80c14ac4-5e9c-5760-8822-17e1f69529fc, identifier: XF75948
2026-03-30 09:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49bf177a-b8c1-5e16-839a-5d2bd76adea7 with identifier: XW57300
2026-03-30 09:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49bf177a-b8c1-5e16-839a-5d2bd76adea7 with scrape type 1
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49bf177a-b8c1-5e16-839a-5d2bd76adea7
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F4d%252F204de91f7c9411b13849bba6f5771e18%252Fpa%252FXW57300_5a63e7833c061848255aedb35e5e42e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_5a63e7833c061848255aedb35e5e42e7.jpg already downloaded
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F4d%252F204de91f7c9411b13849bba6f5771e18%252Fpa%252FXW57300_9ab06e725cbdac2bda22c6cb0d798f00.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_9ab06e725cbdac2bda22c6cb0d798f00.jpg already downloaded
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F4d%252F204de91f7c9411b13849bba6f5771e18%252Fpa%252FXW57300_3690bffede3347f2305321e2c22b6d99.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_3690bffede3347f2305321e2c22b6d99.jpg already downloaded
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F4d%252F204de91f7c9411b13849bba6f5771e18%252Fpa%252FXW57300_494826642c806e95e0d74f50c33d119e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_494826642c806e95e0d74f50c33d119e.jpg already downloaded
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F4d%252F204de91f7c9411b13849bba6f5771e18%252Fpa%252FXW57300_bf101cc70a0d9641159b9f9f2b1d36d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_bf101cc70a0d9641159b9f9f2b1d36d8.jpg already downloaded
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F4d%252F204de91f7c9411b13849bba6f5771e18%252Fpa%252FXW57300_88aa1bdf8d75c221187680029d128b41.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_88aa1bdf8d75c221187680029d128b41.jpg already downloaded
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F4d%252F204de91f7c9411b13849bba6f5771e18%252Fpa%252FXW57300_94678dbbff460191fde7ab883c08407d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_94678dbbff460191fde7ab883c08407d.jpg already downloaded
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F4d%252F204de91f7c9411b13849bba6f5771e18%252Fpa%252FXW57300_7e872fb8a7f75fc0323c7c36ecaa96a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_7e872fb8a7f75fc0323c7c36ecaa96a4.jpg already downloaded
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F4d%252F204de91f7c9411b13849bba6f5771e18%252Fpa%252FXW57300_45bf613dcade81e10ffa4a70f1c8a1ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_45bf613dcade81e10ffa4a70f1c8a1ff.jpg already downloaded
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F4d%252F204de91f7c9411b13849bba6f5771e18%252Fpa%252FXW57300_1ba63d3bb57295557a47f28173326bf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_1ba63d3bb57295557a47f28173326bf9.jpg already downloaded
2026-03-30 09:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49bf177a-b8c1-5e16-839a-5d2bd76adea7, identifier: XW57300
2026-03-30 09:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_c5a202f28aa0a5f1a8372770323ed85b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 80c14ac4-5e9c-5760-8822-17e1f69529fc with identifier: XF75948
2026-03-30 09:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 80c14ac4-5e9c-5760-8822-17e1f69529fc with identifier: XF75948
2026-03-30 09:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 80c14ac4-5e9c-5760-8822-17e1f69529fc with identifier: XF75948 to the API
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XF75948>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:15:34Z',
 'fuel_type': 'petrol',
 'id': '80c14ac4-5e9c-5760-8822-17e1f69529fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF75948',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 120970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_13ef1d7299e2fd9a13c6741553007ccc.jpg',
                'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_9cfd6ac20894750f4cad4ed7774b7447.jpg',
                'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_7a9246a4553c4845c1865a5f260b7269.jpg',
                'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_a53433a91e4525a7a8ae4f7ee88a9605.jpg',
                'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_36a87112a0ad1e474dcfce607c0fdeb3.jpg',
                'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_e73624d04cdf7f794c5c19f39708dc2d.jpg',
                'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_c52af7cf07b503a82e0f6f5e49233c99.jpg',
                'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_3f8c495a4ee1ffe6ad6103eae5883d88.jpg',
                'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_20f131036885bd547c1fd8c1e310a7d0.jpg',
                'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_839dfb0357e479f9f24ca70551aa023f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c14ac4-5e9c-5760-8822-17e1f69529fc/80c14ac4-5e9c-5760-8822-17e1f69529fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_13ef1d7299e2fd9a13c6741553007ccc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c14ac4-5e9c-5760-8822-17e1f69529fc/80c14ac4-5e9c-5760-8822-17e1f69529fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_9cfd6ac20894750f4cad4ed7774b7447.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c14ac4-5e9c-5760-8822-17e1f69529fc/80c14ac4-5e9c-5760-8822-17e1f69529fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_7a9246a4553c4845c1865a5f260b7269.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c14ac4-5e9c-5760-8822-17e1f69529fc/80c14ac4-5e9c-5760-8822-17e1f69529fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_a53433a91e4525a7a8ae4f7ee88a9605.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c14ac4-5e9c-5760-8822-17e1f69529fc/80c14ac4-5e9c-5760-8822-17e1f69529fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_36a87112a0ad1e474dcfce607c0fdeb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c14ac4-5e9c-5760-8822-17e1f69529fc/80c14ac4-5e9c-5760-8822-17e1f69529fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_e73624d04cdf7f794c5c19f39708dc2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c14ac4-5e9c-5760-8822-17e1f69529fc/80c14ac4-5e9c-5760-8822-17e1f69529fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2191704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_c52af7cf07b503a82e0f6f5e49233c99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c14ac4-5e9c-5760-8822-17e1f69529fc/80c14ac4-5e9c-5760-8822-17e1f69529fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_3f8c495a4ee1ffe6ad6103eae5883d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c14ac4-5e9c-5760-8822-17e1f69529fc/80c14ac4-5e9c-5760-8822-17e1f69529fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_20f131036885bd547c1fd8c1e310a7d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80c14ac4-5e9c-5760-8822-17e1f69529fc/80c14ac4-5e9c-5760-8822-17e1f69529fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2386128,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fd/defd5e13bd64fa6493a8f5afdc9bf093/pa/XF75948_839dfb0357e479f9f24ca70551aa023f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Lancia Ypsilon 0.9 TwinAir Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2013}
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF75948%27 HTTP/1.1" 200 None
2026-03-30 09:05:37 [auto1.it] INFO: Saving data for XF75948: {'created_time': 1774861537.720937, 'last_price_update_time': 1774861537.720945, 'auction_closing_time': 1774970134.0}
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XF75948') HTTP/1.1" 204 0
2026-03-30 09:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49bf177a-b8c1-5e16-839a-5d2bd76adea7 with identifier: XW57300
2026-03-30 09:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49bf177a-b8c1-5e16-839a-5d2bd76adea7 with identifier: XW57300
2026-03-30 09:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49bf177a-b8c1-5e16-839a-5d2bd76adea7 with identifier: XW57300 to the API
2026-03-30 09:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XW57300>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:12:54Z',
 'fuel_type': 'diesel',
 'id': '49bf177a-b8c1-5e16-839a-5d2bd76adea7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW57300',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 122597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_5a63e7833c061848255aedb35e5e42e7.jpg',
                'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_9ab06e725cbdac2bda22c6cb0d798f00.jpg',
                'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_3690bffede3347f2305321e2c22b6d99.jpg',
                'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_494826642c806e95e0d74f50c33d119e.jpg',
                'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_bf101cc70a0d9641159b9f9f2b1d36d8.jpg',
                'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_88aa1bdf8d75c221187680029d128b41.jpg',
                'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_94678dbbff460191fde7ab883c08407d.jpg',
                'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_7e872fb8a7f75fc0323c7c36ecaa96a4.jpg',
                'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_45bf613dcade81e10ffa4a70f1c8a1ff.jpg',
                'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_1ba63d3bb57295557a47f28173326bf9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bf177a-b8c1-5e16-839a-5d2bd76adea7/49bf177a-b8c1-5e16-839a-5d2bd76adea7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_5a63e7833c061848255aedb35e5e42e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bf177a-b8c1-5e16-839a-5d2bd76adea7/49bf177a-b8c1-5e16-839a-5d2bd76adea7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_9ab06e725cbdac2bda22c6cb0d798f00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bf177a-b8c1-5e16-839a-5d2bd76adea7/49bf177a-b8c1-5e16-839a-5d2bd76adea7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_3690bffede3347f2305321e2c22b6d99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bf177a-b8c1-5e16-839a-5d2bd76adea7/49bf177a-b8c1-5e16-839a-5d2bd76adea7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_494826642c806e95e0d74f50c33d119e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bf177a-b8c1-5e16-839a-5d2bd76adea7/49bf177a-b8c1-5e16-839a-5d2bd76adea7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_bf101cc70a0d9641159b9f9f2b1d36d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bf177a-b8c1-5e16-839a-5d2bd76adea7/49bf177a-b8c1-5e16-839a-5d2bd76adea7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_88aa1bdf8d75c221187680029d128b41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bf177a-b8c1-5e16-839a-5d2bd76adea7/49bf177a-b8c1-5e16-839a-5d2bd76adea7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_94678dbbff460191fde7ab883c08407d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bf177a-b8c1-5e16-839a-5d2bd76adea7/49bf177a-b8c1-5e16-839a-5d2bd76adea7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_7e872fb8a7f75fc0323c7c36ecaa96a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bf177a-b8c1-5e16-839a-5d2bd76adea7/49bf177a-b8c1-5e16-839a-5d2bd76adea7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_45bf613dcade81e10ffa4a70f1c8a1ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bf177a-b8c1-5e16-839a-5d2bd76adea7/49bf177a-b8c1-5e16-839a-5d2bd76adea7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/4d/204de91f7c9411b13849bba6f5771e18/pa/XW57300_1ba63d3bb57295557a47f28173326bf9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Sport Edition 2',
 'transmission': 'manual',
 'trim': 'Sport Edition 2',
 'year': 2018}
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW57300%27 HTTP/1.1" 200 None
2026-03-30 09:05:38 [auto1.it] INFO: Saving data for XW57300: {'created_time': 1774861538.192225, 'last_price_update_time': 1774861538.192235, 'auction_closing_time': 1774969974.0}
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XW57300') HTTP/1.1" 204 0
2026-03-30 09:05:38 [auto1.it] INFO: Found listing with ID: XR36455
2026-03-30 09:05:38 [auto1.it] INFO: Found listing with ID: VE63363
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE63363%27 HTTP/1.1" 200 None
2026-03-30 09:05:38 [auto1.it] INFO: Scrape type for VE63363: 1
2026-03-30 09:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG27064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR13144/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25a95d0>
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_3e0e707ac2f5dad97f2b007db0c7319e.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_3e0e707ac2f5dad97f2b007db0c7319e.jpg saved to cache
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6272d7c5-299a-5de7-be43-71c33c5b12c3
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee263c410>
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_bf35faa0dc4b8fb22dc23192486a825d.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_bf35faa0dc4b8fb22dc23192486a825d.jpg saved to cache
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6272d7c5-299a-5de7-be43-71c33c5b12c3
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12e4550>
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_073c298e696d1042e52355e962617032.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_073c298e696d1042e52355e962617032.jpg saved to cache
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6272d7c5-299a-5de7-be43-71c33c5b12c3
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2634a10>
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_89acf8fc33056768cc57993ad2cb56e2.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_89acf8fc33056768cc57993ad2cb56e2.jpg saved to cache
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1225ad0>
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_7fb85def24f60fb90ddb7e810c7934bd.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_7fb85def24f60fb90ddb7e810c7934bd.jpg saved to cache
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1
2026-03-30 09:05:38 [auto1.it] INFO: Found listing with ID: ZR86104
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR86104%27 HTTP/1.1" 200 None
2026-03-30 09:05:38 [auto1.it] INFO: Scrape type for ZR86104: 1
2026-03-30 09:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25617d0>
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_c5a202f28aa0a5f1a8372770323ed85b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_c5a202f28aa0a5f1a8372770323ed85b.jpg saved to cache
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6272d7c5-299a-5de7-be43-71c33c5b12c3
2026-03-30 09:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_df344cf59b1d93558d7b847153b60c53.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_22d401e1acfe3bbf62fdf6d96a85322e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:38 [auto1.it] INFO: Found listing with ID: GV71970
2026-03-30 09:05:38 [auto1.it] INFO: Found listing with ID: YV17911
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV17911%27 HTTP/1.1" 200 None
2026-03-30 09:05:38 [auto1.it] INFO: Scrape type for YV17911: 1
2026-03-30 09:05:38 [auto1.it] INFO: Found listing with ID: AL80929
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL80929%27 HTTP/1.1" 200 None
2026-03-30 09:05:38 [auto1.it] INFO: Scrape type for AL80929: 1
2026-03-30 09:05:38 [auto1.it] INFO: Found listing with ID: ZH19388
2026-03-30 09:05:38 [auto1.it] INFO: Found listing with ID: UF13738
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF13738%27 HTTP/1.1" 200 None
2026-03-30 09:05:38 [auto1.it] INFO: Scrape type for UF13738: 2
2026-03-30 09:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6627e64-2f33-5fc6-a894-f6211e829caf with identifier: UF13738
2026-03-30 09:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6627e64-2f33-5fc6-a894-f6211e829caf with scrape type 2
2026-03-30 09:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6627e64-2f33-5fc6-a894-f6211e829caf with scrape type 2
2026-03-30 09:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e6627e64-2f33-5fc6-a894-f6211e829caf, identifier: UF13738
2026-03-30 09:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e6627e64-2f33-5fc6-a894-f6211e829caf with identifier: UF13738
2026-03-30 09:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e6627e64-2f33-5fc6-a894-f6211e829caf with identifier: UF13738
2026-03-30 09:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e6627e64-2f33-5fc6-a894-f6211e829caf with identifier: UF13738 to the API
2026-03-30 09:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:35:44Z',
 'fuel_type': 'diesel',
 'id': 'e6627e64-2f33-5fc6-a894-f6211e829caf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF13738',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 154265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2018}
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF13738%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Saving data for UF13738: {'auction_closing_time': 1774971344.0, 'created_time': 1774473103.43435, 'last_price_update_time': 1774861539.159918}
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UF13738') HTTP/1.1" 204 0
2026-03-30 09:05:39 [auto1.it] INFO: Found listing with ID: RC10955
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC10955%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Scrape type for RC10955: 1
2026-03-30 09:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR35596/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13166d0>
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8f0a463-597b-52a6-bc4f-bd27dee6dd93/a8f0a463-597b-52a6-bc4f-bd27dee6dd93_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fef%252F73ef2856247e87792dc568905ac327e4%252Fpa%252FLU79948_df344cf59b1d93558d7b847153b60c53.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_df344cf59b1d93558d7b847153b60c53.jpg saved to cache
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8f0a463-597b-52a6-bc4f-bd27dee6dd93
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2556010>
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_22d401e1acfe3bbf62fdf6d96a85322e.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_22d401e1acfe3bbf62fdf6d96a85322e.jpg saved to cache
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8513602-c95f-5916-a9c6-6b1300653209
2026-03-30 09:05:39 [auto1.it] INFO: Found listing with ID: ZE75759
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE75759%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Scrape type for ZE75759: 1
2026-03-30 09:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MC43872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN38786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:39 [auto1.it] INFO: Found listing with ID: RA18546
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA18546%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Scrape type for RA18546: 1
2026-03-30 09:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL94253/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:39 [auto1.it] INFO: Found listing with ID: FM86422
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM86422%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Scrape type for FM86422: 1
2026-03-30 09:05:39 [auto1.it] INFO: Found listing with ID: PW67312
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW67312%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Scrape type for PW67312: 1
2026-03-30 09:05:39 [auto1.it] INFO: Found listing with ID: KA76603
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA76603%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Scrape type for KA76603: 1
2026-03-30 09:05:39 [auto1.it] INFO: Found listing with ID: DA30561
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA30561%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [auto1.it] INFO: Scrape type for DA30561: 1
2026-03-30 09:05:39 [auto1.it] INFO: Found listing with ID: UW57613
2026-03-30 09:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ58879> (referer: https://www.auto1.com/v1/car-details-view/XZ58879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d8962d3-1ea2-57f9-add0-ddf0179782ab with identifier: XZ58879
2026-03-30 09:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab with scrape type 1
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_501b6df75ad8eb0893a89e7f9bf9b088.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_501b6df75ad8eb0893a89e7f9bf9b088.jpg not downloaded yet
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_4566e711b6992eeb1124bc32278b5c5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_4566e711b6992eeb1124bc32278b5c5a.jpg not downloaded yet
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_1bf6a320b38855ee5708843fafb79d31.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_1bf6a320b38855ee5708843fafb79d31.jpg not downloaded yet
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_d48566fd9fbcd29a3eb99c4721ed10ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_d48566fd9fbcd29a3eb99c4721ed10ad.jpg not downloaded yet
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_10ea6f178f7bce83af25b706d52ac23e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_10ea6f178f7bce83af25b706d52ac23e.jpg not downloaded yet
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_d5f98c8a590093f3378ccdbd96b8ad23.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_d5f98c8a590093f3378ccdbd96b8ad23.jpg not downloaded yet
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_53c84fd895fa692bb6ce01059832f0ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_53c84fd895fa692bb6ce01059832f0ea.jpg not downloaded yet
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_1efa6be9a2b004f3dfbca5f3f8508a13.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_1efa6be9a2b004f3dfbca5f3f8508a13.jpg not downloaded yet
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_f69732e6840281d0b5c9e7bfc4b34c07.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_f69732e6840281d0b5c9e7bfc4b34c07.jpg not downloaded yet
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_2c11a75abdadf25e8c31f0146a081f5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_2c11a75abdadf25e8c31f0146a081f5d.jpg not downloaded yet
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ45035> (referer: https://www.auto1.com/v1/car-details-view/BJ45035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_2c11a75abdadf25e8c31f0146a081f5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ89669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3ba13d1-2909-5f46-9cff-25b03f9c2417 with identifier: BJ45035
2026-03-30 09:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ba13d1-2909-5f46-9cff-25b03f9c2417 with scrape type 1
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3ba13d1-2909-5f46-9cff-25b03f9c2417
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_f38da9277785af6fecf6b9d288d91e94.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_f38da9277785af6fecf6b9d288d91e94.jpg not downloaded yet
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_f69732e6840281d0b5c9e7bfc4b34c07.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_01323ce8945db760aadd64b34cfd8fbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_01323ce8945db760aadd64b34cfd8fbc.jpg not downloaded yet
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_1efa6be9a2b004f3dfbca5f3f8508a13.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_6be2f67be270e6c5d37ea109373a8f5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_6be2f67be270e6c5d37ea109373a8f5e.jpg not downloaded yet
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_30cb0643783dd6fc9fd19363507cd84b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_30cb0643783dd6fc9fd19363507cd84b.jpg not downloaded yet
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_bff4d4ba75c782881c50fd8bab49921f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_bff4d4ba75c782881c50fd8bab49921f.jpg not downloaded yet
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25f6e50>
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_2c11a75abdadf25e8c31f0146a081f5d.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_2c11a75abdadf25e8c31f0146a081f5d.jpg saved to cache
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_f38da9277785af6fecf6b9d288d91e94.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_53c84fd895fa692bb6ce01059832f0ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_0903437ff4a5014d9e51b5ff2c86e9b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_0903437ff4a5014d9e51b5ff2c86e9b2.jpg not downloaded yet
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_4691bf183304c2f35bda8dabde5916e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_4691bf183304c2f35bda8dabde5916e4.jpg not downloaded yet
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF45749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE63363/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_d4be694a85a949539fa67bec436ebb0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_d4be694a85a949539fa67bec436ebb0a.jpg not downloaded yet
2026-03-30 09:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee254dfd0>
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_f69732e6840281d0b5c9e7bfc4b34c07.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_f69732e6840281d0b5c9e7bfc4b34c07.jpg saved to cache
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26d50d0>
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_1efa6be9a2b004f3dfbca5f3f8508a13.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_1efa6be9a2b004f3dfbca5f3f8508a13.jpg saved to cache
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_d5dfd3b9b282cb45062e8ec32b755e7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_d5dfd3b9b282cb45062e8ec32b755e7e.jpg not downloaded yet
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ13017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee268b350>
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_f38da9277785af6fecf6b9d288d91e94.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_f38da9277785af6fecf6b9d288d91e94.jpg saved to cache
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3ba13d1-2909-5f46-9cff-25b03f9c2417
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12d6190>
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_53c84fd895fa692bb6ce01059832f0ea.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_53c84fd895fa692bb6ce01059832f0ea.jpg saved to cache
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_bff4d4ba75c782881c50fd8bab49921f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_ffbe6a70e3cdd3c5b9da08365745b238.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_ffbe6a70e3cdd3c5b9da08365745b238.jpg not downloaded yet
2026-03-30 09:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_4691bf183304c2f35bda8dabde5916e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_0903437ff4a5014d9e51b5ff2c86e9b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13f1cd0>
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_bff4d4ba75c782881c50fd8bab49921f.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_bff4d4ba75c782881c50fd8bab49921f.jpg saved to cache
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3ba13d1-2909-5f46-9cff-25b03f9c2417
2026-03-30 09:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS88104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2725050>
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_4691bf183304c2f35bda8dabde5916e4.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_4691bf183304c2f35bda8dabde5916e4.jpg saved to cache
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3ba13d1-2909-5f46-9cff-25b03f9c2417
2026-03-30 09:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1441210>
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_0903437ff4a5014d9e51b5ff2c86e9b2.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_0903437ff4a5014d9e51b5ff2c86e9b2.jpg saved to cache
2026-03-30 09:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3ba13d1-2909-5f46-9cff-25b03f9c2417
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT40305/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_d4be694a85a949539fa67bec436ebb0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_d5dfd3b9b282cb45062e8ec32b755e7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13f3150>
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_d4be694a85a949539fa67bec436ebb0a.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_d4be694a85a949539fa67bec436ebb0a.jpg saved to cache
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3ba13d1-2909-5f46-9cff-25b03f9c2417
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_ffbe6a70e3cdd3c5b9da08365745b238.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL85999> (referer: https://www.auto1.com/v1/car-details-view/EL85999/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13ff890>
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_d5dfd3b9b282cb45062e8ec32b755e7e.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_d5dfd3b9b282cb45062e8ec32b755e7e.jpg saved to cache
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3ba13d1-2909-5f46-9cff-25b03f9c2417
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU84761> (referer: https://www.auto1.com/v1/car-details-view/PU84761/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA38100/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13f3bd0>
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_ffbe6a70e3cdd3c5b9da08365745b238.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_ffbe6a70e3cdd3c5b9da08365745b238.jpg saved to cache
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3ba13d1-2909-5f46-9cff-25b03f9c2417
2026-03-30 09:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b222010f-9b3d-5eb1-bba5-e29cffe320c0 with identifier: EL85999
2026-03-30 09:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b222010f-9b3d-5eb1-bba5-e29cffe320c0 with scrape type 1
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b222010f-9b3d-5eb1-bba5-e29cffe320c0
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_b3554ade6fe40c269ba47e298369a332.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_b3554ade6fe40c269ba47e298369a332.jpg not downloaded yet
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_e18183b7891f41333b1ad8c80366e232.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_e18183b7891f41333b1ad8c80366e232.jpg not downloaded yet
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR52700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 101f649a-7192-5d1d-ac93-2c35ed438fe3 with identifier: PU84761
2026-03-30 09:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101f649a-7192-5d1d-ac93-2c35ed438fe3 with scrape type 1
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 101f649a-7192-5d1d-ac93-2c35ed438fe3
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_85d2277cd615af2539dae0f7ef20c0a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_85d2277cd615af2539dae0f7ef20c0a8.jpg not downloaded yet
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_c81781895daababaab16f1092e8f5dc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_c81781895daababaab16f1092e8f5dc1.jpg not downloaded yet
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_9feec0eecd206124acc3cb72636271a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_9feec0eecd206124acc3cb72636271a4.jpg not downloaded yet
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_3739f3247f6e1ec3a03e575107c03da4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_3739f3247f6e1ec3a03e575107c03da4.jpg not downloaded yet
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA18546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_ddb1e1c96f23c1ccbcfebfd83efe7b61.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_ddb1e1c96f23c1ccbcfebfd83efe7b61.jpg not downloaded yet
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_8ea9171d82857534d6751ddff75849db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_8ea9171d82857534d6751ddff75849db.jpg not downloaded yet
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_30cb0643783dd6fc9fd19363507cd84b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_c9a0986aa31ada0117daadc7631651a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_c9a0986aa31ada0117daadc7631651a2.jpg not downloaded yet
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_01323ce8945db760aadd64b34cfd8fbc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_f3b9c25ff1247348db97fa668a58b42d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_f3b9c25ff1247348db97fa668a58b42d.jpg not downloaded yet
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_f0d65751040403b5acf8a9489fe49d32.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_f0d65751040403b5acf8a9489fe49d32.jpg not downloaded yet
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC10955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_2ecb30cc59493b848dcab473d5338ff9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_2ecb30cc59493b848dcab473d5338ff9.jpg not downloaded yet
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_1fa68c96d1d8c40d9cf2bad5432fcc59.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_1fa68c96d1d8c40d9cf2bad5432fcc59.jpg not downloaded yet
2026-03-30 09:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL80929/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_59cbafedbc2c7044b2dbe32ce1da5a21.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_59cbafedbc2c7044b2dbe32ce1da5a21.jpg not downloaded yet
2026-03-30 09:05:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_465e0b3c4695344b4eda4cd61f9d94ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_465e0b3c4695344b4eda4cd61f9d94ff.jpg not downloaded yet
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13ca050>
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_30cb0643783dd6fc9fd19363507cd84b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_30cb0643783dd6fc9fd19363507cd84b.jpg saved to cache
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3ba13d1-2909-5f46-9cff-25b03f9c2417
2026-03-30 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_ddb1e1c96f23c1ccbcfebfd83efe7b61.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_9feec0eecd206124acc3cb72636271a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_d72c1bb988b33c3c987aa2522b8d8294.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_d72c1bb988b33c3c987aa2522b8d8294.jpg not downloaded yet
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_d34cd69867084b872010146b605f397d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_d34cd69867084b872010146b605f397d.jpg not downloaded yet
2026-03-30 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR13144> (referer: https://www.auto1.com/v1/car-details-view/WR13144/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25f63d0>
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_01323ce8945db760aadd64b34cfd8fbc.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_01323ce8945db760aadd64b34cfd8fbc.jpg saved to cache
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3ba13d1-2909-5f46-9cff-25b03f9c2417
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_5bb7585068a78d2caa24dfcbab88c97e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_5bb7585068a78d2caa24dfcbab88c97e.jpg not downloaded yet
2026-03-30 09:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_cb480be6b37ddb57be3076763aaf7e53.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_cb480be6b37ddb57be3076763aaf7e53.jpg not downloaded yet
2026-03-30 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_f0d65751040403b5acf8a9489fe49d32.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_364dd81049745c30753f17a71a3ca8b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_364dd81049745c30753f17a71a3ca8b9.jpg not downloaded yet
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2753e90>
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_ddb1e1c96f23c1ccbcfebfd83efe7b61.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_ddb1e1c96f23c1ccbcfebfd83efe7b61.jpg saved to cache
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 101f649a-7192-5d1d-ac93-2c35ed438fe3
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee147f010>
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_9feec0eecd206124acc3cb72636271a4.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_9feec0eecd206124acc3cb72636271a4.jpg saved to cache
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 101f649a-7192-5d1d-ac93-2c35ed438fe3
2026-03-30 09:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_2ecb30cc59493b848dcab473d5338ff9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0 with identifier: WR13144
2026-03-30 09:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0 with scrape type 1
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F14%252F8914ade56bd4e996597d28dea8d46fc3%252Fpa%252FWR13144_66db9f9a6a1a965382a6ea5eb20b6929.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_66db9f9a6a1a965382a6ea5eb20b6929.jpg already downloaded
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F14%252F8914ade56bd4e996597d28dea8d46fc3%252Fpa%252FWR13144_b16c653bdb353778c0c372ec05b1e71e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_b16c653bdb353778c0c372ec05b1e71e.jpg already downloaded
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F14%252F8914ade56bd4e996597d28dea8d46fc3%252Fpa%252FWR13144_eddf4966961b926e403e99c117d05863.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_eddf4966961b926e403e99c117d05863.jpg already downloaded
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F14%252F8914ade56bd4e996597d28dea8d46fc3%252Fpa%252FWR13144_fedab52aaaab5809ee57709c249d2c3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_fedab52aaaab5809ee57709c249d2c3c.jpg already downloaded
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F14%252F8914ade56bd4e996597d28dea8d46fc3%252Fpa%252FWR13144_bd0b665358c485568248234910722275.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_bd0b665358c485568248234910722275.jpg already downloaded
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F14%252F8914ade56bd4e996597d28dea8d46fc3%252Fpa%252FWR13144_1354f08dee922f8596c088c50f5caac1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_1354f08dee922f8596c088c50f5caac1.jpg already downloaded
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F14%252F8914ade56bd4e996597d28dea8d46fc3%252Fpa%252FWR13144_43dd1f43e3b5c378671c6766abf25139.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_43dd1f43e3b5c378671c6766abf25139.jpg already downloaded
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F14%252F8914ade56bd4e996597d28dea8d46fc3%252Fpa%252FWR13144_02605c08d2e8908730b3fe7213f2a32a.png%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_02605c08d2e8908730b3fe7213f2a32a.png already downloaded
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F14%252F8914ade56bd4e996597d28dea8d46fc3%252Fpa%252FWR13144_7d0e1ccaca1df8f0b7bba3fb194e3885.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_7d0e1ccaca1df8f0b7bba3fb194e3885.jpg already downloaded
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F14%252F8914ade56bd4e996597d28dea8d46fc3%252Fpa%252FWR13144_2d2e3b205ef0d19fdd4147df6b7752cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_2d2e3b205ef0d19fdd4147df6b7752cb.jpg already downloaded
2026-03-30 09:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0, identifier: WR13144
2026-03-30 09:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0 with identifier: WR13144
2026-03-30 09:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0 with identifier: WR13144
2026-03-30 09:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0 with identifier: WR13144 to the API
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WR13144>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.8L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:51:13Z',
 'fuel_type': 'diesel',
 'id': '04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR13144',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 144561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_66db9f9a6a1a965382a6ea5eb20b6929.jpg',
                'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_b16c653bdb353778c0c372ec05b1e71e.jpg',
                'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_eddf4966961b926e403e99c117d05863.jpg',
                'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_fedab52aaaab5809ee57709c249d2c3c.jpg',
                'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_bd0b665358c485568248234910722275.jpg',
                'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_1354f08dee922f8596c088c50f5caac1.jpg',
                'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_43dd1f43e3b5c378671c6766abf25139.jpg',
                'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_02605c08d2e8908730b3fe7213f2a32a.png',
                'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_7d0e1ccaca1df8f0b7bba3fb194e3885.jpg',
                'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_2d2e3b205ef0d19fdd4147df6b7752cb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0/04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_66db9f9a6a1a965382a6ea5eb20b6929.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0/04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_b16c653bdb353778c0c372ec05b1e71e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0/04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_eddf4966961b926e403e99c117d05863.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0/04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0_image_3.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 5106569,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_fedab52aaaab5809ee57709c249d2c3c.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0/04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0_image_4.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 5785165,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_bd0b665358c485568248234910722275.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0/04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0_image_5.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 5022025,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_1354f08dee922f8596c088c50f5caac1.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0/04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_43dd1f43e3b5c378671c6766abf25139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0/04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 2334982,
             'Height': 864,
             'OriginUrl': 'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_02605c08d2e8908730b3fe7213f2a32a.png',
             'Width': 1802},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0/04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0_image_8.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 4394469,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_7d0e1ccaca1df8f0b7bba3fb194e3885.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0/04e695e9-e4cf-5c56-9d98-27eb9aa0e7b0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/14/8914ade56bd4e996597d28dea8d46fc3/pa/WR13144_2d2e3b205ef0d19fdd4147df6b7752cb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Cherokee 2.8 CRD Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2011}
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR13144%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [auto1.it] INFO: Saving data for WR13144: {'created_time': 1774861543.079512, 'last_price_update_time': 1774861543.079523, 'auction_closing_time': 1774972273.0}
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WR13144') HTTP/1.1" 204 0
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24adb10>
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_f0d65751040403b5acf8a9489fe49d32.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_f0d65751040403b5acf8a9489fe49d32.jpg saved to cache
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 101f649a-7192-5d1d-ac93-2c35ed438fe3
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_465e0b3c4695344b4eda4cd61f9d94ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE63363> (referer: https://www.auto1.com/v1/car-details-view/VE63363/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN38786> (referer: https://www.auto1.com/v1/car-details-view/YN38786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ89669> (referer: https://www.auto1.com/v1/car-details-view/CZ89669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_364dd81049745c30753f17a71a3ca8b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ13017> (referer: https://www.auto1.com/v1/car-details-view/XJ13017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF45749> (referer: https://www.auto1.com/v1/car-details-view/ZF45749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1204e50>
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_2ecb30cc59493b848dcab473d5338ff9.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_2ecb30cc59493b848dcab473d5338ff9.jpg saved to cache
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b222010f-9b3d-5eb1-bba5-e29cffe320c0
2026-03-30 09:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_d5f98c8a590093f3378ccdbd96b8ad23.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_6be2f67be270e6c5d37ea109373a8f5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24ac090>
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_465e0b3c4695344b4eda4cd61f9d94ff.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_465e0b3c4695344b4eda4cd61f9d94ff.jpg saved to cache
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 101f649a-7192-5d1d-ac93-2c35ed438fe3
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_8ea9171d82857534d6751ddff75849db.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_d34cd69867084b872010146b605f397d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_cb480be6b37ddb57be3076763aaf7e53.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_5bb7585068a78d2caa24dfcbab88c97e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593972f5-4dc2-5691-932f-927a12aaf614 with identifier: VE63363
2026-03-30 09:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593972f5-4dc2-5691-932f-927a12aaf614 with scrape type 1
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 593972f5-4dc2-5691-932f-927a12aaf614
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_ddb0c345c7dade3172d11312ec0ed3d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_ddb0c345c7dade3172d11312ec0ed3d7.jpg not downloaded yet
2026-03-30 09:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d56847ad-2627-5280-a5cf-3123ddc76d94 with identifier: YN38786
2026-03-30 09:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d56847ad-2627-5280-a5cf-3123ddc76d94 with scrape type 1
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d56847ad-2627-5280-a5cf-3123ddc76d94
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F50%252F575076fee71a3555badf3464015101ea%252Fpa%252FYN38786_bcfedebc08d1f5ddc26673c2b0ae7207.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_bcfedebc08d1f5ddc26673c2b0ae7207.jpg already downloaded
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F50%252F575076fee71a3555badf3464015101ea%252Fpa%252FYN38786_a38f6fae95ce1e8769706a219834f080.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_a38f6fae95ce1e8769706a219834f080.jpg already downloaded
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F50%252F575076fee71a3555badf3464015101ea%252Fpa%252FYN38786_60531cf478d2e3dbea0f7a82a03e5875.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_60531cf478d2e3dbea0f7a82a03e5875.jpg already downloaded
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F50%252F575076fee71a3555badf3464015101ea%252Fpa%252FYN38786_fdea00f7237fcbf92fb1f9e550b15c67.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_fdea00f7237fcbf92fb1f9e550b15c67.jpg already downloaded
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F50%252F575076fee71a3555badf3464015101ea%252Fpa%252FYN38786_071ca6bbf9e7c0504a307dbdb8199f5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_071ca6bbf9e7c0504a307dbdb8199f5f.jpg already downloaded
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F50%252F575076fee71a3555badf3464015101ea%252Fpa%252FYN38786_15b05ca4c169196d5d195455243c8c71.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_15b05ca4c169196d5d195455243c8c71.jpg already downloaded
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F50%252F575076fee71a3555badf3464015101ea%252Fpa%252FYN38786_1ff765413c5bc9aa20f70cf85898ecd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_1ff765413c5bc9aa20f70cf85898ecd9.jpg already downloaded
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F50%252F575076fee71a3555badf3464015101ea%252Fpa%252FYN38786_a69c90cf8fa992694c2d2dafea0a55a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_a69c90cf8fa992694c2d2dafea0a55a1.jpg already downloaded
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F50%252F575076fee71a3555badf3464015101ea%252Fpa%252FYN38786_a74273b0ba9ee09b108cfda524bb81d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_a74273b0ba9ee09b108cfda524bb81d2.jpg already downloaded
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F50%252F575076fee71a3555badf3464015101ea%252Fpa%252FYN38786_e492252ed2e8e823dbd256ddfdc834fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_e492252ed2e8e823dbd256ddfdc834fc.jpg already downloaded
2026-03-30 09:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d56847ad-2627-5280-a5cf-3123ddc76d94, identifier: YN38786
2026-03-30 09:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2ecec97-79c2-5c0f-9c63-24b090b91458 with identifier: CZ89669
2026-03-30 09:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2ecec97-79c2-5c0f-9c63-24b090b91458 with scrape type 1
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2ecec97-79c2-5c0f-9c63-24b090b91458
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Ff3%252F0ef313230cdf05319b1d5ee577f72c22%252Fpa%252FCZ89669_05752abda222a1b3224f5933749d34d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_05752abda222a1b3224f5933749d34d8.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Ff3%252F0ef313230cdf05319b1d5ee577f72c22%252Fpa%252FCZ89669_6abccd87b5223ea5a7c0996cb5b8a524.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_6abccd87b5223ea5a7c0996cb5b8a524.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Ff3%252F0ef313230cdf05319b1d5ee577f72c22%252Fpa%252FCZ89669_f5e607dbb1a69a4a6b687892d1ea4faf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_f5e607dbb1a69a4a6b687892d1ea4faf.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Ff3%252F0ef313230cdf05319b1d5ee577f72c22%252Fpa%252FCZ89669_39d7976acc076b5c154cef75e75dda7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_39d7976acc076b5c154cef75e75dda7b.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Ff3%252F0ef313230cdf05319b1d5ee577f72c22%252Fpa%252FCZ89669_26d6cb683b93b287a373f280386d0305.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_26d6cb683b93b287a373f280386d0305.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Ff3%252F0ef313230cdf05319b1d5ee577f72c22%252Fpa%252FCZ89669_2f6dc75571010b6f53d2ac241c1fcf83.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_2f6dc75571010b6f53d2ac241c1fcf83.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Ff3%252F0ef313230cdf05319b1d5ee577f72c22%252Fpa%252FCZ89669_99e0ede5216720ea37c8852f1f72ffe8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_99e0ede5216720ea37c8852f1f72ffe8.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Ff3%252F0ef313230cdf05319b1d5ee577f72c22%252Fpa%252FCZ89669_d17348577e297c0098f55066b696b3c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_d17348577e297c0098f55066b696b3c9.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Ff3%252F0ef313230cdf05319b1d5ee577f72c22%252Fpa%252FCZ89669_79e9d38c838e9b3f42ff7170607f2c47.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_79e9d38c838e9b3f42ff7170607f2c47.jpg already downloaded
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Ff3%252F0ef313230cdf05319b1d5ee577f72c22%252Fpa%252FCZ89669_11dac7a15aaeca43ae53cbfe69cddb90.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_11dac7a15aaeca43ae53cbfe69cddb90.jpg already downloaded
2026-03-30 09:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a2ecec97-79c2-5c0f-9c63-24b090b91458, identifier: CZ89669
2026-03-30 09:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1477150>
2026-03-30 09:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_364dd81049745c30753f17a71a3ca8b9.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_364dd81049745c30753f17a71a3ca8b9.jpg saved to cache
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 101f649a-7192-5d1d-ac93-2c35ed438fe3
2026-03-30 09:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4890b56-462f-5555-b620-ccc0e0be4c7a with identifier: XJ13017
2026-03-30 09:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4890b56-462f-5555-b620-ccc0e0be4c7a with scrape type 1
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4890b56-462f-5555-b620-ccc0e0be4c7a
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_19c9f28d7e95f0554edda89c3a1c6cc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_19c9f28d7e95f0554edda89c3a1c6cc3.jpg not downloaded yet
2026-03-30 09:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2ab6063-d9f9-50e3-981d-cfc59d9ba631 with identifier: ZF45749
2026-03-30 09:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631 with scrape type 1
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_3926201d12a704d70e7b2b726b3a25ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_3926201d12a704d70e7b2b726b3a25ec.jpg not downloaded yet
2026-03-30 09:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS88104> (referer: https://www.auto1.com/v1/car-details-view/NS88104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d56847ad-2627-5280-a5cf-3123ddc76d94 with identifier: YN38786
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 09:05:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d56847ad-2627-5280-a5cf-3123ddc76d94 with identifier: YN38786
2026-03-30 09:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d56847ad-2627-5280-a5cf-3123ddc76d94 with identifier: YN38786 to the API
2026-03-30 09:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YN38786>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:11:28Z',
 'fuel_type': 'diesel',
 'id': 'd56847ad-2627-5280-a5cf-3123ddc76d94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN38786',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Mazda',
 'model': '6',
 'odometer': 151740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_bcfedebc08d1f5ddc26673c2b0ae7207.jpg',
                'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_a38f6fae95ce1e8769706a219834f080.jpg',
                'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_60531cf478d2e3dbea0f7a82a03e5875.jpg',
                'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_fdea00f7237fcbf92fb1f9e550b15c67.jpg',
                'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_071ca6bbf9e7c0504a307dbdb8199f5f.jpg',
                'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_15b05ca4c169196d5d195455243c8c71.jpg',
                'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_1ff765413c5bc9aa20f70cf85898ecd9.jpg',
                'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_a69c90cf8fa992694c2d2dafea0a55a1.jpg',
                'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_a74273b0ba9ee09b108cfda524bb81d2.jpg',
                'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_e492252ed2e8e823dbd256ddfdc834fc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d56847ad-2627-5280-a5cf-3123ddc76d94/d56847ad-2627-5280-a5cf-3123ddc76d94_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_bcfedebc08d1f5ddc26673c2b0ae7207.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d56847ad-2627-5280-a5cf-3123ddc76d94/d56847ad-2627-5280-a5cf-3123ddc76d94_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_a38f6fae95ce1e8769706a219834f080.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d56847ad-2627-5280-a5cf-3123ddc76d94/d56847ad-2627-5280-a5cf-3123ddc76d94_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_60531cf478d2e3dbea0f7a82a03e5875.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d56847ad-2627-5280-a5cf-3123ddc76d94/d56847ad-2627-5280-a5cf-3123ddc76d94_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_fdea00f7237fcbf92fb1f9e550b15c67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d56847ad-2627-5280-a5cf-3123ddc76d94/d56847ad-2627-5280-a5cf-3123ddc76d94_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_071ca6bbf9e7c0504a307dbdb8199f5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d56847ad-2627-5280-a5cf-3123ddc76d94/d56847ad-2627-5280-a5cf-3123ddc76d94_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_15b05ca4c169196d5d195455243c8c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d56847ad-2627-5280-a5cf-3123ddc76d94/d56847ad-2627-5280-a5cf-3123ddc76d94_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_1ff765413c5bc9aa20f70cf85898ecd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d56847ad-2627-5280-a5cf-3123ddc76d94/d56847ad-2627-5280-a5cf-3123ddc76d94_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_a69c90cf8fa992694c2d2dafea0a55a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d56847ad-2627-5280-a5cf-3123ddc76d94/d56847ad-2627-5280-a5cf-3123ddc76d94_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_a74273b0ba9ee09b108cfda524bb81d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d56847ad-2627-5280-a5cf-3123ddc76d94/d56847ad-2627-5280-a5cf-3123ddc76d94_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/50/575076fee71a3555badf3464015101ea/pa/YN38786_e492252ed2e8e823dbd256ddfdc834fc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Exceed',
 'transmission': 'automatic',
 'trim': 'Exceed',
 'year': 2014}
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN38786%27 HTTP/1.1" 200 None
2026-03-30 09:05:45 [auto1.it] INFO: Saving data for YN38786: {'created_time': 1774861545.153802, 'last_price_update_time': 1774861545.153812, 'auction_closing_time': 1774969888.0}
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YN38786') HTTP/1.1" 204 0
2026-03-30 09:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a2ecec97-79c2-5c0f-9c63-24b090b91458 with identifier: CZ89669
2026-03-30 09:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a2ecec97-79c2-5c0f-9c63-24b090b91458 with identifier: CZ89669
2026-03-30 09:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a2ecec97-79c2-5c0f-9c63-24b090b91458 with identifier: CZ89669 to the API
2026-03-30 09:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CZ89669>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:58:03Z',
 'fuel_type': 'petrol',
 'id': 'a2ecec97-79c2-5c0f-9c63-24b090b91458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ89669',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 137323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_05752abda222a1b3224f5933749d34d8.jpg',
                'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_6abccd87b5223ea5a7c0996cb5b8a524.jpg',
                'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_f5e607dbb1a69a4a6b687892d1ea4faf.jpg',
                'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_39d7976acc076b5c154cef75e75dda7b.jpg',
                'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_26d6cb683b93b287a373f280386d0305.jpg',
                'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_2f6dc75571010b6f53d2ac241c1fcf83.jpg',
                'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_99e0ede5216720ea37c8852f1f72ffe8.jpg',
                'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_d17348577e297c0098f55066b696b3c9.jpg',
                'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_79e9d38c838e9b3f42ff7170607f2c47.jpg',
                'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_11dac7a15aaeca43ae53cbfe69cddb90.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ecec97-79c2-5c0f-9c63-24b090b91458/a2ecec97-79c2-5c0f-9c63-24b090b91458_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2426572,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_05752abda222a1b3224f5933749d34d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ecec97-79c2-5c0f-9c63-24b090b91458/a2ecec97-79c2-5c0f-9c63-24b090b91458_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2571626,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_6abccd87b5223ea5a7c0996cb5b8a524.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ecec97-79c2-5c0f-9c63-24b090b91458/a2ecec97-79c2-5c0f-9c63-24b090b91458_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_f5e607dbb1a69a4a6b687892d1ea4faf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ecec97-79c2-5c0f-9c63-24b090b91458/a2ecec97-79c2-5c0f-9c63-24b090b91458_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2583367,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_39d7976acc076b5c154cef75e75dda7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ecec97-79c2-5c0f-9c63-24b090b91458/a2ecec97-79c2-5c0f-9c63-24b090b91458_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2717656,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_26d6cb683b93b287a373f280386d0305.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ecec97-79c2-5c0f-9c63-24b090b91458/a2ecec97-79c2-5c0f-9c63-24b090b91458_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2609713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_2f6dc75571010b6f53d2ac241c1fcf83.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ecec97-79c2-5c0f-9c63-24b090b91458/a2ecec97-79c2-5c0f-9c63-24b090b91458_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519735,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_99e0ede5216720ea37c8852f1f72ffe8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ecec97-79c2-5c0f-9c63-24b090b91458/a2ecec97-79c2-5c0f-9c63-24b090b91458_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693077,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_d17348577e297c0098f55066b696b3c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ecec97-79c2-5c0f-9c63-24b090b91458/a2ecec97-79c2-5c0f-9c63-24b090b91458_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2401478,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_79e9d38c838e9b3f42ff7170607f2c47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2ecec97-79c2-5c0f-9c63-24b090b91458/a2ecec97-79c2-5c0f-9c63-24b090b91458_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2623230,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/f3/0ef313230cdf05319b1d5ee577f72c22/pa/CZ89669_11dac7a15aaeca43ae53cbfe69cddb90.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Elefantino II',
 'transmission': 'manual',
 'trim': 'Elefantino II',
 'year': 2014}
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ89669%27 HTTP/1.1" 200 None
2026-03-30 09:05:46 [auto1.it] INFO: Saving data for CZ89669: {'created_time': 1774861546.163225, 'last_price_update_time': 1774861546.163237, 'auction_closing_time': 1774972683.0}
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ89669') HTTP/1.1" 204 0
2026-03-30 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_1fa68c96d1d8c40d9cf2bad5432fcc59.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_3036c518d7c88344d904bf9451f3ac50.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_3036c518d7c88344d904bf9451f3ac50.jpg not downloaded yet
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_7b4f2ff1a5771f50984693a49cea24db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_7b4f2ff1a5771f50984693a49cea24db.jpg not downloaded yet
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_c6fabacfd3745975a171c5d06f743d9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_c6fabacfd3745975a171c5d06f743d9a.jpg not downloaded yet
2026-03-30 09:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11aac90>
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_d5f98c8a590093f3378ccdbd96b8ad23.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_d5f98c8a590093f3378ccdbd96b8ad23.jpg saved to cache
2026-03-30 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab
2026-03-30 09:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee141a350>
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fdc%252F11dc10e5ffc18ac7dd44d1104bdeffca%252Fpa%252FBJ45035_6be2f67be270e6c5d37ea109373a8f5e.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_6be2f67be270e6c5d37ea109373a8f5e.jpg saved to cache
2026-03-30 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3ba13d1-2909-5f46-9cff-25b03f9c2417
2026-03-30 09:05:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3ba13d1-2909-5f46-9cff-25b03f9c2417, skipping ID generation
2026-03-30 09:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ba13d1-2909-5f46-9cff-25b03f9c2417 with scrape type 1
2026-03-30 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3ba13d1-2909-5f46-9cff-25b03f9c2417 sending to next pipeline
2026-03-30 09:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3ba13d1-2909-5f46-9cff-25b03f9c2417, identifier: BJ45035
2026-03-30 09:05:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1450510>
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_8ea9171d82857534d6751ddff75849db.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_8ea9171d82857534d6751ddff75849db.jpg saved to cache
2026-03-30 09:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b222010f-9b3d-5eb1-bba5-e29cffe320c0
2026-03-30 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_d72c1bb988b33c3c987aa2522b8d8294.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL80929> (referer: https://www.auto1.com/v1/car-details-view/AL80929/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3ba13d1-2909-5f46-9cff-25b03f9c2417 with identifier: BJ45035
2026-03-30 09:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3ba13d1-2909-5f46-9cff-25b03f9c2417 with identifier: BJ45035
2026-03-30 09:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3ba13d1-2909-5f46-9cff-25b03f9c2417 with identifier: BJ45035 to the API
2026-03-30 09:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_6be2f67be270e6c5d37ea109373a8f5e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 87,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:44:43Z',
 'fuel_type': 'hybrid',
 'id': 'd3ba13d1-2909-5f46-9cff-25b03f9c2417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ45035',
 'listing': 'auction',
 'location': 'IT, Torino',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 130356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_f38da9277785af6fecf6b9d288d91e94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_01323ce8945db760aadd64b34cfd8fbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2754149,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_6be2f67be270e6c5d37ea109373a8f5e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_30cb0643783dd6fc9fd19363507cd84b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_bff4d4ba75c782881c50fd8bab49921f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2586671,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_0903437ff4a5014d9e51b5ff2c86e9b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_4691bf183304c2f35bda8dabde5916e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2602653,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_d4be694a85a949539fa67bec436ebb0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2760481,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_d5dfd3b9b282cb45062e8ec32b755e7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3ba13d1-2909-5f46-9cff-25b03f9c2417/d3ba13d1-2909-5f46-9cff-25b03f9c2417_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2839325,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img11/dc/11dc10e5ffc18ac7dd44d1104bdeffca/pa/BJ45035_ffbe6a70e3cdd3c5b9da08365745b238.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2018}
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ45035%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [auto1.it] INFO: Saving data for BJ45035: {'created_time': 1774861547.292032, 'last_price_update_time': 1774861547.292044, 'auction_closing_time': 1774971883.0}
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ45035') HTTP/1.1" 204 0
2026-03-30 09:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_59cbafedbc2c7044b2dbe32ce1da5a21.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_67afe835352bc5d500746cceda711f60.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_67afe835352bc5d500746cceda711f60.jpg not downloaded yet
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_1aacbf46d1d55303fa91a55c5703a16c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_1aacbf46d1d55303fa91a55c5703a16c.jpg not downloaded yet
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_9bb9453989b483663b7d45cb8a1b9db6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_9bb9453989b483663b7d45cb8a1b9db6.jpg not downloaded yet
2026-03-30 09:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT40305> (referer: https://www.auto1.com/v1/car-details-view/HT40305/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2546e90>
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_d34cd69867084b872010146b605f397d.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_d34cd69867084b872010146b605f397d.jpg saved to cache
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 101f649a-7192-5d1d-ac93-2c35ed438fe3
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2755e10>
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_cb480be6b37ddb57be3076763aaf7e53.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_cb480be6b37ddb57be3076763aaf7e53.jpg saved to cache
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 101f649a-7192-5d1d-ac93-2c35ed438fe3
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12782d0>
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_5bb7585068a78d2caa24dfcbab88c97e.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_5bb7585068a78d2caa24dfcbab88c97e.jpg saved to cache
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b222010f-9b3d-5eb1-bba5-e29cffe320c0
2026-03-30 09:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc43e943-c61c-5e92-8974-4128deb292a9 with identifier: NS88104
2026-03-30 09:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc43e943-c61c-5e92-8974-4128deb292a9 with scrape type 1
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc43e943-c61c-5e92-8974-4128deb292a9
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Faa%252F61aaece30499c8510e6f81c24e63bff0%252Fpa%252FNS88104_3d31b4b2dfac0d18fe4424b2bf2137e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_3d31b4b2dfac0d18fe4424b2bf2137e2.jpg already downloaded
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Faa%252F61aaece30499c8510e6f81c24e63bff0%252Fpa%252FNS88104_f16139c7475d32dd23d9a2ed5bb463c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_f16139c7475d32dd23d9a2ed5bb463c5.jpg already downloaded
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Faa%252F61aaece30499c8510e6f81c24e63bff0%252Fpa%252FNS88104_84d3276c4cb6e1a34baefba725b816ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_84d3276c4cb6e1a34baefba725b816ea.jpg already downloaded
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Faa%252F61aaece30499c8510e6f81c24e63bff0%252Fpa%252FNS88104_bdc9ab33d77457c8c7c47db8285e1228.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_bdc9ab33d77457c8c7c47db8285e1228.jpg already downloaded
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Faa%252F61aaece30499c8510e6f81c24e63bff0%252Fpa%252FNS88104_92effcfe27755c78c747ed7ac23ce5ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_92effcfe27755c78c747ed7ac23ce5ec.jpg already downloaded
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Faa%252F61aaece30499c8510e6f81c24e63bff0%252Fpa%252FNS88104_a7a28cc12b093ecc7110b3e3d9257f48.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_a7a28cc12b093ecc7110b3e3d9257f48.jpg already downloaded
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Faa%252F61aaece30499c8510e6f81c24e63bff0%252Fpa%252FNS88104_d09469895696a4663c0027b452149654.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_d09469895696a4663c0027b452149654.jpg already downloaded
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Faa%252F61aaece30499c8510e6f81c24e63bff0%252Fpa%252FNS88104_8dcfbc415bb78fcff9a3dbbd9d875885.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_8dcfbc415bb78fcff9a3dbbd9d875885.jpg already downloaded
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Faa%252F61aaece30499c8510e6f81c24e63bff0%252Fpa%252FNS88104_fd901838615eb186c34510463d7ccd52.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_fd901838615eb186c34510463d7ccd52.jpg already downloaded
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Faa%252F61aaece30499c8510e6f81c24e63bff0%252Fpa%252FNS88104_ac4f265ff41a0a46208dbf7647559308.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_ac4f265ff41a0a46208dbf7647559308.jpg already downloaded
2026-03-30 09:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bc43e943-c61c-5e92-8974-4128deb292a9, identifier: NS88104
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26bbf10>
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_1fa68c96d1d8c40d9cf2bad5432fcc59.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_1fa68c96d1d8c40d9cf2bad5432fcc59.jpg saved to cache
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 101f649a-7192-5d1d-ac93-2c35ed438fe3
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_0ce2bdf878b748eac1fc711d4d2752fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_0ce2bdf878b748eac1fc711d4d2752fe.jpg not downloaded yet
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_0197763816dbf32b81aac7ec44c6f6d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_0197763816dbf32b81aac7ec44c6f6d2.jpg not downloaded yet
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_358e18b6aff62cd5cc3647b14619e98d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_358e18b6aff62cd5cc3647b14619e98d.jpg not downloaded yet
2026-03-30 09:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC10955> (referer: https://www.auto1.com/v1/car-details-view/RC10955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bc43e943-c61c-5e92-8974-4128deb292a9 with identifier: NS88104
2026-03-30 09:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bc43e943-c61c-5e92-8974-4128deb292a9 with identifier: NS88104
2026-03-30 09:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bc43e943-c61c-5e92-8974-4128deb292a9 with identifier: NS88104 to the API
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NS88104>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:26:36Z',
 'fuel_type': 'petrol',
 'id': 'bc43e943-c61c-5e92-8974-4128deb292a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS88104',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 291082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_3d31b4b2dfac0d18fe4424b2bf2137e2.jpg',
                'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_f16139c7475d32dd23d9a2ed5bb463c5.jpg',
                'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_84d3276c4cb6e1a34baefba725b816ea.jpg',
                'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_bdc9ab33d77457c8c7c47db8285e1228.jpg',
                'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_92effcfe27755c78c747ed7ac23ce5ec.jpg',
                'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_a7a28cc12b093ecc7110b3e3d9257f48.jpg',
                'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_d09469895696a4663c0027b452149654.jpg',
                'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_8dcfbc415bb78fcff9a3dbbd9d875885.jpg',
                'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_fd901838615eb186c34510463d7ccd52.jpg',
                'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_ac4f265ff41a0a46208dbf7647559308.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc43e943-c61c-5e92-8974-4128deb292a9/bc43e943-c61c-5e92-8974-4128deb292a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_3d31b4b2dfac0d18fe4424b2bf2137e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc43e943-c61c-5e92-8974-4128deb292a9/bc43e943-c61c-5e92-8974-4128deb292a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_f16139c7475d32dd23d9a2ed5bb463c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc43e943-c61c-5e92-8974-4128deb292a9/bc43e943-c61c-5e92-8974-4128deb292a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_84d3276c4cb6e1a34baefba725b816ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc43e943-c61c-5e92-8974-4128deb292a9/bc43e943-c61c-5e92-8974-4128deb292a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_bdc9ab33d77457c8c7c47db8285e1228.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc43e943-c61c-5e92-8974-4128deb292a9/bc43e943-c61c-5e92-8974-4128deb292a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_92effcfe27755c78c747ed7ac23ce5ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc43e943-c61c-5e92-8974-4128deb292a9/bc43e943-c61c-5e92-8974-4128deb292a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_a7a28cc12b093ecc7110b3e3d9257f48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc43e943-c61c-5e92-8974-4128deb292a9/bc43e943-c61c-5e92-8974-4128deb292a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_d09469895696a4663c0027b452149654.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc43e943-c61c-5e92-8974-4128deb292a9/bc43e943-c61c-5e92-8974-4128deb292a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_8dcfbc415bb78fcff9a3dbbd9d875885.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc43e943-c61c-5e92-8974-4128deb292a9/bc43e943-c61c-5e92-8974-4128deb292a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_fd901838615eb186c34510463d7ccd52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc43e943-c61c-5e92-8974-4128deb292a9/bc43e943-c61c-5e92-8974-4128deb292a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/aa/61aaece30499c8510e6f81c24e63bff0/pa/NS88104_ac4f265ff41a0a46208dbf7647559308.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TGI Executive BlueMotion',
 'transmission': 'manual',
 'trim': 'Executive BlueMotion',
 'year': 2018}
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS88104%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [auto1.it] INFO: Saving data for NS88104: {'created_time': 1774861548.270064, 'last_price_update_time': 1774861548.270074, 'auction_closing_time': 1774970796.0}
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NS88104') HTTP/1.1" 204 0
2026-03-30 09:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27f4190>
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_d72c1bb988b33c3c987aa2522b8d8294.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_d72c1bb988b33c3c987aa2522b8d8294.jpg saved to cache
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b222010f-9b3d-5eb1-bba5-e29cffe320c0
2026-03-30 09:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb2db70e-284d-5937-9306-589a8e5e457c with identifier: AL80929
2026-03-30 09:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2db70e-284d-5937-9306-589a8e5e457c with scrape type 1
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb2db70e-284d-5937-9306-589a8e5e457c
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_15f60b79be329bb32606f994f9857242.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_15f60b79be329bb32606f994f9857242.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_c3d2bd960282a51930b68f117d486055.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_c3d2bd960282a51930b68f117d486055.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_202ea38c7452bdbefa6b008822ea93f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_202ea38c7452bdbefa6b008822ea93f0.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_5c1245d207005d4c7ea3fce75a6f6cba.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_5c1245d207005d4c7ea3fce75a6f6cba.jpg not downloaded yet
2026-03-30 09:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1486ad0>
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_59cbafedbc2c7044b2dbe32ce1da5a21.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_59cbafedbc2c7044b2dbe32ce1da5a21.jpg saved to cache
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b222010f-9b3d-5eb1-bba5-e29cffe320c0
2026-03-30 09:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5390ed0-9d2f-53ac-9002-857a2aca66da with identifier: HT40305
2026-03-30 09:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5390ed0-9d2f-53ac-9002-857a2aca66da with scrape type 1
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5390ed0-9d2f-53ac-9002-857a2aca66da
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_676337baf7b658cceb56a26b4bf44cb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_676337baf7b658cceb56a26b4bf44cb3.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_858818b71dc3d65f190267337a9a6802.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_858818b71dc3d65f190267337a9a6802.jpg not downloaded yet
2026-03-30 09:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA18546> (referer: https://www.auto1.com/v1/car-details-view/RA18546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_d12b14a3031e3981c80db4790b848a08.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_d12b14a3031e3981c80db4790b848a08.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_887fc4a1f9603e1163951a96d879d2cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_887fc4a1f9603e1163951a96d879d2cb.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_9b73c4f78a9a12f08ddf8f5da0e68115.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_9b73c4f78a9a12f08ddf8f5da0e68115.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_73eb80f5f6f2bbe728d279dc4a500619.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_73eb80f5f6f2bbe728d279dc4a500619.jpg not downloaded yet
2026-03-30 09:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a216706-1062-5131-9d86-18ddaff421f2 with identifier: RC10955
2026-03-30 09:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a216706-1062-5131-9d86-18ddaff421f2 with scrape type 1
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a216706-1062-5131-9d86-18ddaff421f2
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_c5667239b3ca6ec6401a0aa398568ff4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_c5667239b3ca6ec6401a0aa398568ff4.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_81d09a22a538a5b2e70b634b35badfcb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_81d09a22a538a5b2e70b634b35badfcb.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_c71d8e7eb003a8444d4565fb5a4415d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_c71d8e7eb003a8444d4565fb5a4415d9.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_e1b50b81cd1d03f8b9b45fb151fb1b84.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_e1b50b81cd1d03f8b9b45fb151fb1b84.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_cfd215ee42d12d6c6394b6de92a123a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_cfd215ee42d12d6c6394b6de92a123a9.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_c2743b1a3678b7e56633f7aa0162e5c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_c2743b1a3678b7e56633f7aa0162e5c1.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_01e9d52355b949e79bd71f34564d9ef7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_01e9d52355b949e79bd71f34564d9ef7.jpg not downloaded yet
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_9418e8599987987fa5fe8f6f3cc3383b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_9418e8599987987fa5fe8f6f3cc3383b.jpg not downloaded yet
2026-03-30 09:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 491c1a72-69fa-5040-be19-3708f9a26072 with identifier: RA18546
2026-03-30 09:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 491c1a72-69fa-5040-be19-3708f9a26072 with scrape type 1
2026-03-30 09:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 491c1a72-69fa-5040-be19-3708f9a26072
2026-03-30 09:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8f%252F788fd8c41edfddc38771cc2a467e3b0c%252Fpa%252FRA18546_9f76c629c92233e9ccef572226a77e01.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_9f76c629c92233e9ccef572226a77e01.jpg already downloaded
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8f%252F788fd8c41edfddc38771cc2a467e3b0c%252Fpa%252FRA18546_179b4c78827a16189832ca1739b4f1ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_179b4c78827a16189832ca1739b4f1ba.jpg already downloaded
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8f%252F788fd8c41edfddc38771cc2a467e3b0c%252Fpa%252FRA18546_6aa52f3fe39786b2684950620a29618f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_6aa52f3fe39786b2684950620a29618f.jpg already downloaded
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8f%252F788fd8c41edfddc38771cc2a467e3b0c%252Fpa%252FRA18546_b1f8818f08564a0c0d2ba51000bf6b70.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_b1f8818f08564a0c0d2ba51000bf6b70.jpg already downloaded
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8f%252F788fd8c41edfddc38771cc2a467e3b0c%252Fpa%252FRA18546_d0f3eab0778ec22b7d1334e11d6d5316.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_d0f3eab0778ec22b7d1334e11d6d5316.jpg already downloaded
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8f%252F788fd8c41edfddc38771cc2a467e3b0c%252Fpa%252FRA18546_0baf00fe417a0d8f92a7cace2566daaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_0baf00fe417a0d8f92a7cace2566daaf.jpg already downloaded
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8f%252F788fd8c41edfddc38771cc2a467e3b0c%252Fpa%252FRA18546_1d9df591c64a9a878cab74b292cce733.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_1d9df591c64a9a878cab74b292cce733.jpg already downloaded
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8f%252F788fd8c41edfddc38771cc2a467e3b0c%252Fpa%252FRA18546_c7dc154cc6b4956a9a3a65b74f2c3f5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_c7dc154cc6b4956a9a3a65b74f2c3f5d.jpg already downloaded
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8f%252F788fd8c41edfddc38771cc2a467e3b0c%252Fpa%252FRA18546_7503aea8b32e9ae46fc6bb249734c63f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_7503aea8b32e9ae46fc6bb249734c63f.jpg already downloaded
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8f%252F788fd8c41edfddc38771cc2a467e3b0c%252Fpa%252FRA18546_767352692792dc27903b90344d7b8a00.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_767352692792dc27903b90344d7b8a00.jpg already downloaded
2026-03-30 09:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 491c1a72-69fa-5040-be19-3708f9a26072, identifier: RA18546
2026-03-30 09:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_0197763816dbf32b81aac7ec44c6f6d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_d73b737a6d92a103a743c19e12e57402.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_d73b737a6d92a103a743c19e12e57402.jpg not downloaded yet
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_db36dbf84e0a641aa2161e57f18af36c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_db36dbf84e0a641aa2161e57f18af36c.jpg not downloaded yet
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_a51288b6e4c627ab1ebb9c9a860b1cba.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_a51288b6e4c627ab1ebb9c9a860b1cba.jpg not downloaded yet
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_d1dbdd87c2745619aef2201cd74020e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_d1dbdd87c2745619aef2201cd74020e8.jpg not downloaded yet
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_32ce462777be178edb9adc266078dffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_32ce462777be178edb9adc266078dffc.jpg not downloaded yet
2026-03-30 09:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 491c1a72-69fa-5040-be19-3708f9a26072 with identifier: RA18546
2026-03-30 09:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 491c1a72-69fa-5040-be19-3708f9a26072 with identifier: RA18546
2026-03-30 09:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 491c1a72-69fa-5040-be19-3708f9a26072 with identifier: RA18546 to the API
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA18546>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:38:37Z',
 'fuel_type': 'diesel',
 'id': '491c1a72-69fa-5040-be19-3708f9a26072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA18546',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 64027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_9f76c629c92233e9ccef572226a77e01.jpg',
                'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_179b4c78827a16189832ca1739b4f1ba.jpg',
                'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_6aa52f3fe39786b2684950620a29618f.jpg',
                'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_b1f8818f08564a0c0d2ba51000bf6b70.jpg',
                'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_d0f3eab0778ec22b7d1334e11d6d5316.jpg',
                'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_0baf00fe417a0d8f92a7cace2566daaf.jpg',
                'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_1d9df591c64a9a878cab74b292cce733.jpg',
                'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_c7dc154cc6b4956a9a3a65b74f2c3f5d.jpg',
                'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_7503aea8b32e9ae46fc6bb249734c63f.jpg',
                'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_767352692792dc27903b90344d7b8a00.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2938abf-5df5-5d6f-82eb-7fad96baad6b/d2938abf-5df5-5d6f-82eb-7fad96baad6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_9f76c629c92233e9ccef572226a77e01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2938abf-5df5-5d6f-82eb-7fad96baad6b/d2938abf-5df5-5d6f-82eb-7fad96baad6b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_179b4c78827a16189832ca1739b4f1ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2938abf-5df5-5d6f-82eb-7fad96baad6b/d2938abf-5df5-5d6f-82eb-7fad96baad6b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_6aa52f3fe39786b2684950620a29618f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2938abf-5df5-5d6f-82eb-7fad96baad6b/d2938abf-5df5-5d6f-82eb-7fad96baad6b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_b1f8818f08564a0c0d2ba51000bf6b70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2938abf-5df5-5d6f-82eb-7fad96baad6b/d2938abf-5df5-5d6f-82eb-7fad96baad6b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_d0f3eab0778ec22b7d1334e11d6d5316.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2938abf-5df5-5d6f-82eb-7fad96baad6b/d2938abf-5df5-5d6f-82eb-7fad96baad6b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_0baf00fe417a0d8f92a7cace2566daaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2938abf-5df5-5d6f-82eb-7fad96baad6b/d2938abf-5df5-5d6f-82eb-7fad96baad6b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_1d9df591c64a9a878cab74b292cce733.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2938abf-5df5-5d6f-82eb-7fad96baad6b/d2938abf-5df5-5d6f-82eb-7fad96baad6b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_c7dc154cc6b4956a9a3a65b74f2c3f5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2938abf-5df5-5d6f-82eb-7fad96baad6b/d2938abf-5df5-5d6f-82eb-7fad96baad6b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_7503aea8b32e9ae46fc6bb249734c63f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2938abf-5df5-5d6f-82eb-7fad96baad6b/d2938abf-5df5-5d6f-82eb-7fad96baad6b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/8f/788fd8c41edfddc38771cc2a467e3b0c/pa/RA18546_767352692792dc27903b90344d7b8a00.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA18546%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [auto1.it] INFO: Saving data for RA18546: {'created_time': 1774861549.793187, 'last_price_update_time': 1774861549.793199, 'auction_closing_time': 1774971517.0}
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA18546') HTTP/1.1" 204 0
2026-03-30 09:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_202ea38c7452bdbefa6b008822ea93f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_5c1245d207005d4c7ea3fce75a6f6cba.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_15f60b79be329bb32606f994f9857242.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_80b19b17538c7752326744d4b16f6801.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_80b19b17538c7752326744d4b16f6801.jpg not downloaded yet
2026-03-30 09:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_c3d2bd960282a51930b68f117d486055.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_2aa197f6cf5bc609add54676e3677c79.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_2aa197f6cf5bc609add54676e3677c79.jpg not downloaded yet
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_840c890d3c412bef4ed7c590b129df58.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_840c890d3c412bef4ed7c590b129df58.jpg not downloaded yet
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_c0359c3e5ed44fe91e784281918248d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_c0359c3e5ed44fe91e784281918248d1.jpg not downloaded yet
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_2f6eaf83054b8872792a0d4e4a91fe6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_2f6eaf83054b8872792a0d4e4a91fe6b.jpg not downloaded yet
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_195b8db69002d3483b8c4881d6a1dd84.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_195b8db69002d3483b8c4881d6a1dd84.jpg not downloaded yet
2026-03-30 09:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR52700> (referer: https://www.auto1.com/v1/car-details-view/XR52700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_4a85621ac57d6bbca7b2fd9cb263595e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_4a85621ac57d6bbca7b2fd9cb263595e.jpg not downloaded yet
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_1aacbf46d1d55303fa91a55c5703a16c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_7f1626a8bd0d4928fe2981f5c8fd8e89.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_7f1626a8bd0d4928fe2981f5c8fd8e89.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_4350b0e3a558ca42a180cbc3f22dee3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_4350b0e3a558ca42a180cbc3f22dee3a.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_b2ab5274beefbf4e2b069b0db2da1fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_b2ab5274beefbf4e2b069b0db2da1fc7.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_ae9dce6781420d8d4c291de12664faed.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_ae9dce6781420d8d4c291de12664faed.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_e0ee130babe38e278cf7e9c8be25f5ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_e0ee130babe38e278cf7e9c8be25f5ba.jpg not downloaded yet
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee144b050>
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_0197763816dbf32b81aac7ec44c6f6d2.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_0197763816dbf32b81aac7ec44c6f6d2.jpg saved to cache
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4890b56-462f-5555-b620-ccc0e0be4c7a
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_ca66b7a70cb94b65ca80666ab0c863c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_ca66b7a70cb94b65ca80666ab0c863c2.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_f141324c410495beecd7cf80fe821d1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_f141324c410495beecd7cf80fe821d1a.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_745b2a2a0c7bb90c1b5417bed56b3ae9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_745b2a2a0c7bb90c1b5417bed56b3ae9.jpg not downloaded yet
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_9bb9453989b483663b7d45cb8a1b9db6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_67afe835352bc5d500746cceda711f60.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_c6fabacfd3745975a171c5d06f743d9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_8b20237bc45ef97a78bcd4c3738ddca4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_8b20237bc45ef97a78bcd4c3738ddca4.jpg not downloaded yet
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee275b390>
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_202ea38c7452bdbefa6b008822ea93f0.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_202ea38c7452bdbefa6b008822ea93f0.jpg saved to cache
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4890b56-462f-5555-b620-ccc0e0be4c7a
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24a7490>
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_5c1245d207005d4c7ea3fce75a6f6cba.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_5c1245d207005d4c7ea3fce75a6f6cba.jpg saved to cache
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1086ad0>
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_15f60b79be329bb32606f994f9857242.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_15f60b79be329bb32606f994f9857242.jpg saved to cache
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb2db70e-284d-5937-9306-589a8e5e457c
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26f2a10>
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_c3d2bd960282a51930b68f117d486055.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_c3d2bd960282a51930b68f117d486055.jpg saved to cache
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 593972f5-4dc2-5691-932f-927a12aaf614
2026-03-30 09:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d75f974f-ca01-5a1e-a579-5bcf704d65c9 with identifier: XR52700
2026-03-30 09:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75f974f-ca01-5a1e-a579-5bcf704d65c9 with scrape type 1
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d75f974f-ca01-5a1e-a579-5bcf704d65c9
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_1f8caf92f0ddd759bd4348d465f06a71.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_1f8caf92f0ddd759bd4348d465f06a71.jpg not downloaded yet
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27470d0>
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_1aacbf46d1d55303fa91a55c5703a16c.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_1aacbf46d1d55303fa91a55c5703a16c.jpg saved to cache
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4890b56-462f-5555-b620-ccc0e0be4c7a
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_7b4f2ff1a5771f50984693a49cea24db.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_9bef979863d0eb048630fb178f49cc5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_9bef979863d0eb048630fb178f49cc5c.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_3e3c4c07fab1fa1a0a4e8db2d8796fcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_3e3c4c07fab1fa1a0a4e8db2d8796fcc.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_7e5591ecfd9235fb630378e567357d0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_7e5591ecfd9235fb630378e567357d0f.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_1b73c431533f84489e1108469743a3aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_1b73c431533f84489e1108469743a3aa.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_09ec9ae4b0fc8d1381c5b0f8e1d61d8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_09ec9ae4b0fc8d1381c5b0f8e1d61d8e.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_e5a25112deec41bb11ed75226210fe1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_e5a25112deec41bb11ed75226210fe1b.jpg not downloaded yet
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2506c10>
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_9bb9453989b483663b7d45cb8a1b9db6.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_9bb9453989b483663b7d45cb8a1b9db6.jpg saved to cache
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee260a990>
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_67afe835352bc5d500746cceda711f60.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_67afe835352bc5d500746cceda711f60.jpg saved to cache
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 593972f5-4dc2-5691-932f-927a12aaf614
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2502c50>
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_c6fabacfd3745975a171c5d06f743d9a.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_c6fabacfd3745975a171c5d06f743d9a.jpg saved to cache
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_41962393e9bfca02b59a478db0f6f670.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_41962393e9bfca02b59a478db0f6f670.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_73e7d31ed37450d07b8d496d63dbdbea.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_73e7d31ed37450d07b8d496d63dbdbea.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_986eef52a38ef4653a355367034f74cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_986eef52a38ef4653a355367034f74cc.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_a24f9c0e7e658148081a1b21042aaffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_a24f9c0e7e658148081a1b21042aaffc.jpg not downloaded yet
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_c2743b1a3678b7e56633f7aa0162e5c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_01e9d52355b949e79bd71f34564d9ef7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_9418e8599987987fa5fe8f6f3cc3383b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_53dd48c22b3615510aaa1879189c692b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_53dd48c22b3615510aaa1879189c692b.jpg not downloaded yet
2026-03-30 09:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_8daf8fc118666232d6170a9d49025ca5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_8daf8fc118666232d6170a9d49025ca5.jpg not downloaded yet
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_73682d92a88907efedc72c7279701945.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_73682d92a88907efedc72c7279701945.jpg not downloaded yet
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13a0790>
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_7b4f2ff1a5771f50984693a49cea24db.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_7b4f2ff1a5771f50984693a49cea24db.jpg saved to cache
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4890b56-462f-5555-b620-ccc0e0be4c7a
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_39bb6aef6fcc11e06fb660a83434e4f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_39bb6aef6fcc11e06fb660a83434e4f9.jpg not downloaded yet
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26214d0>
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_c2743b1a3678b7e56633f7aa0162e5c1.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_c2743b1a3678b7e56633f7aa0162e5c1.jpg saved to cache
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5390ed0-9d2f-53ac-9002-857a2aca66da
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2649cd0>
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_01e9d52355b949e79bd71f34564d9ef7.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_01e9d52355b949e79bd71f34564d9ef7.jpg saved to cache
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a216706-1062-5131-9d86-18ddaff421f2
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2739c50>
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_9418e8599987987fa5fe8f6f3cc3383b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_9418e8599987987fa5fe8f6f3cc3383b.jpg saved to cache
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb2db70e-284d-5937-9306-589a8e5e457c
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_e7daadd9f0211f77e80c598653b17b74.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_e7daadd9f0211f77e80c598653b17b74.jpg not downloaded yet
2026-03-30 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_195b8db69002d3483b8c4881d6a1dd84.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_32ce462777be178edb9adc266078dffc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_2f6eaf83054b8872792a0d4e4a91fe6b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_cb1a8d1fcbecef01bd9c5f1fb1f2eb35.png%27 HTTP/1.1" 200 None
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_cb1a8d1fcbecef01bd9c5f1fb1f2eb35.png not downloaded yet
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_412a2561fdb65330c5c29df2b4f94fe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_412a2561fdb65330c5c29df2b4f94fe0.jpg not downloaded yet
2026-03-30 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_f3b9c25ff1247348db97fa668a58b42d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_e4f1cd69164f608483e1997e69b68e29.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_e4f1cd69164f608483e1997e69b68e29.jpg not downloaded yet
2026-03-30 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_358e18b6aff62cd5cc3647b14619e98d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_cfd215ee42d12d6c6394b6de92a123a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2607690>
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_195b8db69002d3483b8c4881d6a1dd84.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_195b8db69002d3483b8c4881d6a1dd84.jpg saved to cache
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a216706-1062-5131-9d86-18ddaff421f2
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26072d0>
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_32ce462777be178edb9adc266078dffc.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_32ce462777be178edb9adc266078dffc.jpg saved to cache
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a216706-1062-5131-9d86-18ddaff421f2
2026-03-30 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_73e7d31ed37450d07b8d496d63dbdbea.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c7bd0>
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_2f6eaf83054b8872792a0d4e4a91fe6b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_2f6eaf83054b8872792a0d4e4a91fe6b.jpg saved to cache
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5390ed0-9d2f-53ac-9002-857a2aca66da
2026-03-30 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_ca66b7a70cb94b65ca80666ab0c863c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_e0ee130babe38e278cf7e9c8be25f5ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_ae9dce6781420d8d4c291de12664faed.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c50d0>
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_f3b9c25ff1247348db97fa668a58b42d.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_f3b9c25ff1247348db97fa668a58b42d.jpg saved to cache
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b222010f-9b3d-5eb1-bba5-e29cffe320c0
2026-03-30 09:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24a7450>
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_358e18b6aff62cd5cc3647b14619e98d.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_358e18b6aff62cd5cc3647b14619e98d.jpg saved to cache
2026-03-30 09:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631
2026-03-30 09:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1302290>
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_cfd215ee42d12d6c6394b6de92a123a9.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_cfd215ee42d12d6c6394b6de92a123a9.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24f68d0>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_73e7d31ed37450d07b8d496d63dbdbea.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_73e7d31ed37450d07b8d496d63dbdbea.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d75f974f-ca01-5a1e-a579-5bcf704d65c9
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_676337baf7b658cceb56a26b4bf44cb3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_41962393e9bfca02b59a478db0f6f670.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12fbed0>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_ca66b7a70cb94b65ca80666ab0c863c2.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_ca66b7a70cb94b65ca80666ab0c863c2.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb2db70e-284d-5937-9306-589a8e5e457c
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c5550>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_e0ee130babe38e278cf7e9c8be25f5ba.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_e0ee130babe38e278cf7e9c8be25f5ba.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a216706-1062-5131-9d86-18ddaff421f2
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1193810>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_ae9dce6781420d8d4c291de12664faed.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_ae9dce6781420d8d4c291de12664faed.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5390ed0-9d2f-53ac-9002-857a2aca66da
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_412a2561fdb65330c5c29df2b4f94fe0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_39bb6aef6fcc11e06fb660a83434e4f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_73682d92a88907efedc72c7279701945.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee4638050>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_676337baf7b658cceb56a26b4bf44cb3.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_676337baf7b658cceb56a26b4bf44cb3.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5390ed0-9d2f-53ac-9002-857a2aca66da
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26b8a10>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_41962393e9bfca02b59a478db0f6f670.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_41962393e9bfca02b59a478db0f6f670.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb2db70e-284d-5937-9306-589a8e5e457c
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_e4f1cd69164f608483e1997e69b68e29.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_0ce2bdf878b748eac1fc711d4d2752fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2709610>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_412a2561fdb65330c5c29df2b4f94fe0.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_412a2561fdb65330c5c29df2b4f94fe0.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d75f974f-ca01-5a1e-a579-5bcf704d65c9
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee126f350>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_39bb6aef6fcc11e06fb660a83434e4f9.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_39bb6aef6fcc11e06fb660a83434e4f9.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d75f974f-ca01-5a1e-a579-5bcf704d65c9
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24a6190>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_73682d92a88907efedc72c7279701945.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_73682d92a88907efedc72c7279701945.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d75f974f-ca01-5a1e-a579-5bcf704d65c9
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_e7daadd9f0211f77e80c598653b17b74.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 09:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 09:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 09:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-30 09:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee4625790>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_e4f1cd69164f608483e1997e69b68e29.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_e4f1cd69164f608483e1997e69b68e29.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d75f974f-ca01-5a1e-a579-5bcf704d65c9
2026-03-30 09:05:52 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-30 09:05:52 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-30 09:05:52 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x008\xe5\x15\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xb7\x94\x008Z(\x00\x00\x00\x00'
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2879010>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_3.mpo HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_0ce2bdf878b748eac1fc711d4d2752fe.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_0ce2bdf878b748eac1fc711d4d2752fe.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 593972f5-4dc2-5691-932f-927a12aaf614
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_53dd48c22b3615510aaa1879189c692b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_8daf8fc118666232d6170a9d49025ca5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_09ec9ae4b0fc8d1381c5b0f8e1d61d8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27f42d0>
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_e7daadd9f0211f77e80c598653b17b74.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_e7daadd9f0211f77e80c598653b17b74.jpg saved to cache
2026-03-30 09:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d75f974f-ca01-5a1e-a579-5bcf704d65c9
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_cb1a8d1fcbecef01bd9c5f1fb1f2eb35.png> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_745b2a2a0c7bb90c1b5417bed56b3ae9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_e5a25112deec41bb11ed75226210fe1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_986eef52a38ef4653a355367034f74cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_a24f9c0e7e658148081a1b21042aaffc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee129c550>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_53dd48c22b3615510aaa1879189c692b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_53dd48c22b3615510aaa1879189c692b.jpg saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d75f974f-ca01-5a1e-a579-5bcf704d65c9
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13024d0>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_8daf8fc118666232d6170a9d49025ca5.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_8daf8fc118666232d6170a9d49025ca5.jpg saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1a216706-1062-5131-9d86-18ddaff421f2
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_1b73c431533f84489e1108469743a3aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_1f8caf92f0ddd759bd4348d465f06a71.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2760550>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_09ec9ae4b0fc8d1381c5b0f8e1d61d8e.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_09ec9ae4b0fc8d1381c5b0f8e1d61d8e.jpg saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5390ed0-9d2f-53ac-9002-857a2aca66da
2026-03-30 09:05:53 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 09:05:53 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-30 09:05:53 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-30 09:05:53 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-30 09:05:53 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12d5050>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_7.png HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_cb1a8d1fcbecef01bd9c5f1fb1f2eb35.png') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_cb1a8d1fcbecef01bd9c5f1fb1f2eb35.png saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d75f974f-ca01-5a1e-a579-5bcf704d65c9
2026-03-30 09:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee34d25d0>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_745b2a2a0c7bb90c1b5417bed56b3ae9.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_745b2a2a0c7bb90c1b5417bed56b3ae9.jpg saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a216706-1062-5131-9d86-18ddaff421f2
2026-03-30 09:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee258ab90>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_e5a25112deec41bb11ed75226210fe1b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_e5a25112deec41bb11ed75226210fe1b.jpg saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a216706-1062-5131-9d86-18ddaff421f2
2026-03-30 09:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee119a410>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_986eef52a38ef4653a355367034f74cc.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_986eef52a38ef4653a355367034f74cc.jpg saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5390ed0-9d2f-53ac-9002-857a2aca66da
2026-03-30 09:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee276fe10>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_a24f9c0e7e658148081a1b21042aaffc.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_a24f9c0e7e658148081a1b21042aaffc.jpg saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1a216706-1062-5131-9d86-18ddaff421f2
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_7e5591ecfd9235fb630378e567357d0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_4350b0e3a558ca42a180cbc3f22dee3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_3e3c4c07fab1fa1a0a4e8db2d8796fcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_9bef979863d0eb048630fb178f49cc5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_8b20237bc45ef97a78bcd4c3738ddca4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2643e90>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_1b73c431533f84489e1108469743a3aa.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_1b73c431533f84489e1108469743a3aa.jpg saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d75f974f-ca01-5a1e-a579-5bcf704d65c9
2026-03-30 09:05:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 09:05:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 09:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 09:05:53 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-30 09:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13d5a10>
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F52%252F3152944d25e27240aecaa62f713d548a%252Fpa%252FXR52700_1f8caf92f0ddd759bd4348d465f06a71.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_1f8caf92f0ddd759bd4348d465f06a71.jpg saved to cache
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d75f974f-ca01-5a1e-a579-5bcf704d65c9
2026-03-30 09:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d75f974f-ca01-5a1e-a579-5bcf704d65c9, skipping ID generation
2026-03-30 09:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75f974f-ca01-5a1e-a579-5bcf704d65c9 with scrape type 1
2026-03-30 09:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d75f974f-ca01-5a1e-a579-5bcf704d65c9 sending to next pipeline
2026-03-30 09:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d75f974f-ca01-5a1e-a579-5bcf704d65c9, identifier: XR52700
2026-03-30 09:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d75f974f-ca01-5a1e-a579-5bcf704d65c9 with identifier: XR52700
2026-03-30 09:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d75f974f-ca01-5a1e-a579-5bcf704d65c9 with identifier: XR52700
2026-03-30 09:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d75f974f-ca01-5a1e-a579-5bcf704d65c9 with identifier: XR52700 to the API
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_1f8caf92f0ddd759bd4348d465f06a71.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 275,
 'expiration_date': '2026-03-31T15:09:45Z',
 'fuel_type': 'diesel',
 'id': 'd75f974f-ca01-5a1e-a579-5bcf704d65c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR52700',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 162533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31056,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_1f8caf92f0ddd759bd4348d465f06a71.jpg',
             'Width': 768},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36293,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_1b73c431533f84489e1108469743a3aa.jpg',
             'Width': 768},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32108,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_73e7d31ed37450d07b8d496d63dbdbea.jpg',
             'Width': 768},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32108,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_53dd48c22b3615510aaa1879189c692b.jpg',
             'Width': 768},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32682,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_73682d92a88907efedc72c7279701945.jpg',
             'Width': 768},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37196,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_39bb6aef6fcc11e06fb660a83434e4f9.jpg',
             'Width': 768},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37196,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_e7daadd9f0211f77e80c598653b17b74.jpg',
             'Width': 768},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 678832,
             'Height': 785,
             'OriginUrl': 'https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_cb1a8d1fcbecef01bd9c5f1fb1f2eb35.png',
             'Width': 562},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43490,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_412a2561fdb65330c5c29df2b4f94fe0.jpg',
             'Width': 768},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75f974f-ca01-5a1e-a579-5bcf704d65c9/d75f974f-ca01-5a1e-a579-5bcf704d65c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35951,
             'Height': 512,
             'OriginUrl': 'https://img-pa.auto1.com/img31/52/3152944d25e27240aecaa62f713d548a/pa/XR52700_e4f1cd69164f608483e1997e69b68e29.jpg',
             'Width': 768}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR52700%27 HTTP/1.1" 200 None
2026-03-30 09:05:54 [auto1.it] INFO: Saving data for XR52700: {'created_time': 1774861554.749184, 'last_price_update_time': 1774861554.749195, 'auction_closing_time': 1774969785.0}
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XR52700') HTTP/1.1" 204 0
2026-03-30 09:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_840c890d3c412bef4ed7c590b129df58.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_c0359c3e5ed44fe91e784281918248d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_4a85621ac57d6bbca7b2fd9cb263595e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_80b19b17538c7752326744d4b16f6801.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA38100> (referer: https://www.auto1.com/v1/car-details-view/KA38100/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12790d0>
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_7e5591ecfd9235fb630378e567357d0f.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_7e5591ecfd9235fb630378e567357d0f.jpg saved to cache
2026-03-30 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb2db70e-284d-5937-9306-589a8e5e457c
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee260b050>
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_4350b0e3a558ca42a180cbc3f22dee3a.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_4350b0e3a558ca42a180cbc3f22dee3a.jpg saved to cache
2026-03-30 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4890b56-462f-5555-b620-ccc0e0be4c7a
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25ba350>
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_3e3c4c07fab1fa1a0a4e8db2d8796fcc.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_3e3c4c07fab1fa1a0a4e8db2d8796fcc.jpg saved to cache
2026-03-30 09:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a216706-1062-5131-9d86-18ddaff421f2
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee129e190>
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_9bef979863d0eb048630fb178f49cc5c.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_9bef979863d0eb048630fb178f49cc5c.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5390ed0-9d2f-53ac-9002-857a2aca66da
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24a4fd0>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_8b20237bc45ef97a78bcd4c3738ddca4.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_8b20237bc45ef97a78bcd4c3738ddca4.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb2db70e-284d-5937-9306-589a8e5e457c
2026-03-30 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_db36dbf84e0a641aa2161e57f18af36c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_a51288b6e4c627ab1ebb9c9a860b1cba.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_d1dbdd87c2745619aef2201cd74020e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee129c6d0>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_840c890d3c412bef4ed7c590b129df58.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_840c890d3c412bef4ed7c590b129df58.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4890b56-462f-5555-b620-ccc0e0be4c7a
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48ce750>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_c0359c3e5ed44fe91e784281918248d1.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_c0359c3e5ed44fe91e784281918248d1.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee255e110>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_4a85621ac57d6bbca7b2fd9cb263595e.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_4a85621ac57d6bbca7b2fd9cb263595e.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb2db70e-284d-5937-9306-589a8e5e457c
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13bae90>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_80b19b17538c7752326744d4b16f6801.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_80b19b17538c7752326744d4b16f6801.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb2db70e-284d-5937-9306-589a8e5e457c
2026-03-30 09:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c936c8-3dab-52b4-9d70-f9b93200b40e with identifier: KA38100
2026-03-30 09:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c936c8-3dab-52b4-9d70-f9b93200b40e with scrape type 1
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36c936c8-3dab-52b4-9d70-f9b93200b40e
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_850fffff7f74ebff11ca81d4f86ed6d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_850fffff7f74ebff11ca81d4f86ed6d5.jpg not downloaded yet
2026-03-30 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_e1b50b81cd1d03f8b9b45fb151fb1b84.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_2ffba7093229f9efd9d9287fd28f8a75.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_2ffba7093229f9efd9d9287fd28f8a75.jpg not downloaded yet
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_79f4b1f63f6c19d742ec52370f3320bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_79f4b1f63f6c19d742ec52370f3320bb.jpg not downloaded yet
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26eeb10>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_db36dbf84e0a641aa2161e57f18af36c.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_db36dbf84e0a641aa2161e57f18af36c.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4890b56-462f-5555-b620-ccc0e0be4c7a
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee286ca50>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_a51288b6e4c627ab1ebb9c9a860b1cba.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_a51288b6e4c627ab1ebb9c9a860b1cba.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee28688d0>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_d1dbdd87c2745619aef2201cd74020e8.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_d1dbdd87c2745619aef2201cd74020e8.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5390ed0-9d2f-53ac-9002-857a2aca66da
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_fd2c888eed4d70f589bb3cf8f0936474.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_fd2c888eed4d70f589bb3cf8f0936474.jpg not downloaded yet
2026-03-30 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_c5667239b3ca6ec6401a0aa398568ff4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_81d09a22a538a5b2e70b634b35badfcb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_adad516daac63ac7e2ca9a0a402da2ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_adad516daac63ac7e2ca9a0a402da2ab.jpg not downloaded yet
2026-03-30 09:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_c71d8e7eb003a8444d4565fb5a4415d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_1e18ea5c92ef151c21c0753e550d3fa7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_1e18ea5c92ef151c21c0753e550d3fa7.jpg not downloaded yet
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee286b450>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_e1b50b81cd1d03f8b9b45fb151fb1b84.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_e1b50b81cd1d03f8b9b45fb151fb1b84.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4890b56-462f-5555-b620-ccc0e0be4c7a
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_10ae64e6cc760a87da9c8f0f9857bfa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_10ae64e6cc760a87da9c8f0f9857bfa8.jpg not downloaded yet
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_8def168fc1d1fddf6cb188bdd3c5ae0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_8def168fc1d1fddf6cb188bdd3c5ae0b.jpg not downloaded yet
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26bbb10>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fa6%252F0fa6caa7d3a017bc17d3a06601bf693b%252Fpa%252FRC10955_c5667239b3ca6ec6401a0aa398568ff4.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_c5667239b3ca6ec6401a0aa398568ff4.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a216706-1062-5131-9d86-18ddaff421f2
2026-03-30 09:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a216706-1062-5131-9d86-18ddaff421f2, skipping ID generation
2026-03-30 09:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a216706-1062-5131-9d86-18ddaff421f2 with scrape type 1
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a216706-1062-5131-9d86-18ddaff421f2 sending to next pipeline
2026-03-30 09:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1a216706-1062-5131-9d86-18ddaff421f2, identifier: RC10955
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1279510>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_81d09a22a538a5b2e70b634b35badfcb.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_81d09a22a538a5b2e70b634b35badfcb.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb2db70e-284d-5937-9306-589a8e5e457c
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee264bfd0>
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_c71d8e7eb003a8444d4565fb5a4415d9.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_c71d8e7eb003a8444d4565fb5a4415d9.jpg saved to cache
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 593972f5-4dc2-5691-932f-927a12aaf614
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_79c72dc6ef99508771a407ff5c69bada.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_79c72dc6ef99508771a407ff5c69bada.jpg not downloaded yet
2026-03-30 09:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1a216706-1062-5131-9d86-18ddaff421f2 with identifier: RC10955
2026-03-30 09:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1a216706-1062-5131-9d86-18ddaff421f2 with identifier: RC10955
2026-03-30 09:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1a216706-1062-5131-9d86-18ddaff421f2 with identifier: RC10955 to the API
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_c5667239b3ca6ec6401a0aa398568ff4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:54:49Z',
 'fuel_type': 'petrol',
 'id': '1a216706-1062-5131-9d86-18ddaff421f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC10955',
 'listing': 'auction',
 'location': 'IT, Rozzano',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 139388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_c5667239b3ca6ec6401a0aa398568ff4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_01e9d52355b949e79bd71f34564d9ef7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_32ce462777be178edb9adc266078dffc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_195b8db69002d3483b8c4881d6a1dd84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_e0ee130babe38e278cf7e9c8be25f5ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3321131,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_745b2a2a0c7bb90c1b5417bed56b3ae9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_3e3c4c07fab1fa1a0a4e8db2d8796fcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3397205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_e5a25112deec41bb11ed75226210fe1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3223215,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_a24f9c0e7e658148081a1b21042aaffc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a216706-1062-5131-9d86-18ddaff421f2/1a216706-1062-5131-9d86-18ddaff421f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/a6/0fa6caa7d3a017bc17d3a06601bf693b/pa/RC10955_8daf8fc118666232d6170a9d49025ca5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC10955%27 HTTP/1.1" 200 None
2026-03-30 09:05:56 [auto1.it] INFO: Saving data for RC10955: {'created_time': 1774861556.777672, 'last_price_update_time': 1774861556.777681, 'auction_closing_time': 1774972489.0}
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC10955') HTTP/1.1" 204 0
2026-03-30 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_887fc4a1f9603e1163951a96d879d2cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_9b73c4f78a9a12f08ddf8f5da0e68115.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_73eb80f5f6f2bbe728d279dc4a500619.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_ec69e08dabb4e1868f7e8192aa982881.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_ec69e08dabb4e1868f7e8192aa982881.jpg not downloaded yet
2026-03-30 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_b2ab5274beefbf4e2b069b0db2da1fc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_f141324c410495beecd7cf80fe821d1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_2aa197f6cf5bc609add54676e3677c79.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_7f1626a8bd0d4928fe2981f5c8fd8e89.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_d73b737a6d92a103a743c19e12e57402.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1295dd0>
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_887fc4a1f9603e1163951a96d879d2cb.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_887fc4a1f9603e1163951a96d879d2cb.jpg saved to cache
2026-03-30 09:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4890b56-462f-5555-b620-ccc0e0be4c7a
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee28094d0>
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_9b73c4f78a9a12f08ddf8f5da0e68115.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_9b73c4f78a9a12f08ddf8f5da0e68115.jpg saved to cache
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631
2026-03-30 09:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_850fffff7f74ebff11ca81d4f86ed6d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_79f4b1f63f6c19d742ec52370f3320bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1295dd0>
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_73eb80f5f6f2bbe728d279dc4a500619.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_73eb80f5f6f2bbe728d279dc4a500619.jpg saved to cache
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5390ed0-9d2f-53ac-9002-857a2aca66da
2026-03-30 09:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2507f90>
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_b2ab5274beefbf4e2b069b0db2da1fc7.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_b2ab5274beefbf4e2b069b0db2da1fc7.jpg saved to cache
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631
2026-03-30 09:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee28276d0>
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252Ffd%252Ff5fd86ad9154cc5a5833346993244e57%252Fpa%252FHT40305_f141324c410495beecd7cf80fe821d1a.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_f141324c410495beecd7cf80fe821d1a.jpg saved to cache
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5390ed0-9d2f-53ac-9002-857a2aca66da
2026-03-30 09:05:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5390ed0-9d2f-53ac-9002-857a2aca66da, skipping ID generation
2026-03-30 09:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5390ed0-9d2f-53ac-9002-857a2aca66da with scrape type 1
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5390ed0-9d2f-53ac-9002-857a2aca66da sending to next pipeline
2026-03-30 09:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5390ed0-9d2f-53ac-9002-857a2aca66da, identifier: HT40305
2026-03-30 09:05:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-30 09:05:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-30 09:05:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00.X\xdf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x92I\x00-\xdbc\x00\x00\x00\x00'
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13d7a10>
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_8.mpo HTTP/1.1" 201 0
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_2aa197f6cf5bc609add54676e3677c79.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_2aa197f6cf5bc609add54676e3677c79.jpg saved to cache
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 593972f5-4dc2-5691-932f-927a12aaf614
2026-03-30 09:05:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-30 09:05:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-30 09:05:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x007\xef7\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xc4\x16\x007k\xcb\x00\x00\x00\x00'
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c6890>
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_9.mpo HTTP/1.1" 201 0
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_7f1626a8bd0d4928fe2981f5c8fd8e89.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_7f1626a8bd0d4928fe2981f5c8fd8e89.jpg saved to cache
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 593972f5-4dc2-5691-932f-927a12aaf614
2026-03-30 09:05:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-30 09:05:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-30 09:05:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00<S\x9e\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xd1\x9f\x00<I\n\x00\x00\x00\x00'
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1249390>
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_7.mpo HTTP/1.1" 201 0
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_d73b737a6d92a103a743c19e12e57402.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_d73b737a6d92a103a743c19e12e57402.jpg saved to cache
2026-03-30 09:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 593972f5-4dc2-5691-932f-927a12aaf614
2026-03-30 09:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_858818b71dc3d65f190267337a9a6802.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_fd2c888eed4d70f589bb3cf8f0936474.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_adad516daac63ac7e2ca9a0a402da2ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5390ed0-9d2f-53ac-9002-857a2aca66da with identifier: HT40305
2026-03-30 09:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5390ed0-9d2f-53ac-9002-857a2aca66da with identifier: HT40305
2026-03-30 09:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5390ed0-9d2f-53ac-9002-857a2aca66da with identifier: HT40305 to the API
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_f141324c410495beecd7cf80fe821d1a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:18:25Z',
 'fuel_type': 'diesel',
 'id': 'f5390ed0-9d2f-53ac-9002-857a2aca66da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT40305',
 'listing': 'auction',
 'location': 'IT, Casagiove',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 114178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3621691,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_676337baf7b658cceb56a26b4bf44cb3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_73eb80f5f6f2bbe728d279dc4a500619.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_c2743b1a3678b7e56633f7aa0162e5c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_d1dbdd87c2745619aef2201cd74020e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_2f6eaf83054b8872792a0d4e4a91fe6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_ae9dce6781420d8d4c291de12664faed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3075659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_f141324c410495beecd7cf80fe821d1a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_9bef979863d0eb048630fb178f49cc5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_09ec9ae4b0fc8d1381c5b0f8e1d61d8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5390ed0-9d2f-53ac-9002-857a2aca66da/f5390ed0-9d2f-53ac-9002-857a2aca66da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2849506,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/fd/f5fd86ad9154cc5a5833346993244e57/pa/HT40305_986eef52a38ef4653a355367034f74cc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 D2 Dynamic Edition',
 'transmission': 'automatic',
 'trim': 'Dynamic Edition',
 'year': 2018}
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT40305%27 HTTP/1.1" 200 None
2026-03-30 09:05:58 [auto1.it] INFO: Saving data for HT40305: {'created_time': 1774861558.470399, 'last_price_update_time': 1774861558.470412, 'auction_closing_time': 1774970305.0}
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HT40305') HTTP/1.1" 204 0
2026-03-30 09:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_d12b14a3031e3981c80db4790b848a08.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_8def168fc1d1fddf6cb188bdd3c5ae0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee499e790>
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_850fffff7f74ebff11ca81d4f86ed6d5.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_850fffff7f74ebff11ca81d4f86ed6d5.jpg saved to cache
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36c936c8-3dab-52b4-9d70-f9b93200b40e
2026-03-30 09:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_3036c518d7c88344d904bf9451f3ac50.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_10ae64e6cc760a87da9c8f0f9857bfa8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee280fe50>
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_79f4b1f63f6c19d742ec52370f3320bb.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_79f4b1f63f6c19d742ec52370f3320bb.jpg saved to cache
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36c936c8-3dab-52b4-9d70-f9b93200b40e
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12e4190>
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252F03%252Fd803a03d7ade4521267f7bf41904cde1%252Fpa%252FAL80929_858818b71dc3d65f190267337a9a6802.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_858818b71dc3d65f190267337a9a6802.jpg saved to cache
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb2db70e-284d-5937-9306-589a8e5e457c
2026-03-30 09:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb2db70e-284d-5937-9306-589a8e5e457c, skipping ID generation
2026-03-30 09:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2db70e-284d-5937-9306-589a8e5e457c with scrape type 1
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb2db70e-284d-5937-9306-589a8e5e457c sending to next pipeline
2026-03-30 09:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb2db70e-284d-5937-9306-589a8e5e457c, identifier: AL80929
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26e3ad0>
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_fd2c888eed4d70f589bb3cf8f0936474.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_fd2c888eed4d70f589bb3cf8f0936474.jpg saved to cache
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36c936c8-3dab-52b4-9d70-f9b93200b40e
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1440d10>
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_adad516daac63ac7e2ca9a0a402da2ab.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_adad516daac63ac7e2ca9a0a402da2ab.jpg saved to cache
2026-03-30 09:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36c936c8-3dab-52b4-9d70-f9b93200b40e
2026-03-30 09:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb2db70e-284d-5937-9306-589a8e5e457c with identifier: AL80929
2026-03-30 09:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb2db70e-284d-5937-9306-589a8e5e457c with identifier: AL80929
2026-03-30 09:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb2db70e-284d-5937-9306-589a8e5e457c with identifier: AL80929 to the API
2026-03-30 09:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_858818b71dc3d65f190267337a9a6802.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:32:56Z',
 'fuel_type': 'diesel',
 'id': 'fb2db70e-284d-5937-9306-589a8e5e457c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL80929',
 'listing': 'auction',
 'location': 'IT, San Giovanni Teatino',
 'make': 'Volkswagen',
 'model': 'Eos',
 'odometer': 130849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_15f60b79be329bb32606f994f9857242.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_858818b71dc3d65f190267337a9a6802.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_81d09a22a538a5b2e70b634b35badfcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_9418e8599987987fa5fe8f6f3cc3383b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_80b19b17538c7752326744d4b16f6801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_4a85621ac57d6bbca7b2fd9cb263595e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_ca66b7a70cb94b65ca80666ab0c863c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_8b20237bc45ef97a78bcd4c3738ddca4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_7e5591ecfd9235fb630378e567357d0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb2db70e-284d-5937-9306-589a8e5e457c/fb2db70e-284d-5937-9306-589a8e5e457c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/03/d803a03d7ade4521267f7bf41904cde1/pa/AL80929_41962393e9bfca02b59a478db0f6f670.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Eos 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL80929%27 HTTP/1.1" 200 None
2026-03-30 09:05:59 [auto1.it] INFO: Saving data for AL80929: {'created_time': 1774861559.522768, 'last_price_update_time': 1774861559.522786, 'auction_closing_time': 1774971176.0}
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL80929') HTTP/1.1" 204 0
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_ec69e08dabb4e1868f7e8192aa982881.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_19c9f28d7e95f0554edda89c3a1c6cc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_1e18ea5c92ef151c21c0753e550d3fa7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_c9a0986aa31ada0117daadc7631651a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_79c72dc6ef99508771a407ff5c69bada.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2809710>
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_d12b14a3031e3981c80db4790b848a08.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_d12b14a3031e3981c80db4790b848a08.jpg saved to cache
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 593972f5-4dc2-5691-932f-927a12aaf614
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee124a490>
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_8def168fc1d1fddf6cb188bdd3c5ae0b.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_8def168fc1d1fddf6cb188bdd3c5ae0b.jpg saved to cache
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36c936c8-3dab-52b4-9d70-f9b93200b40e
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee119bbd0>
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_3036c518d7c88344d904bf9451f3ac50.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_3036c518d7c88344d904bf9451f3ac50.jpg saved to cache
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 593972f5-4dc2-5691-932f-927a12aaf614
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2708510>
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_10ae64e6cc760a87da9c8f0f9857bfa8.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_10ae64e6cc760a87da9c8f0f9857bfa8.jpg saved to cache
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36c936c8-3dab-52b4-9d70-f9b93200b40e
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_2ffba7093229f9efd9d9287fd28f8a75.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_ddb0c345c7dade3172d11312ec0ed3d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee119ba50>
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_ec69e08dabb4e1868f7e8192aa982881.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_ec69e08dabb4e1868f7e8192aa982881.jpg saved to cache
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36c936c8-3dab-52b4-9d70-f9b93200b40e
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee263c1d0>
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Ffb%252F7afb9309b1f29d8d707c3a03c61300d6%252Fpa%252FXJ13017_19c9f28d7e95f0554edda89c3a1c6cc3.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_19c9f28d7e95f0554edda89c3a1c6cc3.jpg saved to cache
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4890b56-462f-5555-b620-ccc0e0be4c7a
2026-03-30 09:05:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4890b56-462f-5555-b620-ccc0e0be4c7a, skipping ID generation
2026-03-30 09:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4890b56-462f-5555-b620-ccc0e0be4c7a with scrape type 1
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4890b56-462f-5555-b620-ccc0e0be4c7a sending to next pipeline
2026-03-30 09:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4890b56-462f-5555-b620-ccc0e0be4c7a, identifier: XJ13017
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2643910>
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_1e18ea5c92ef151c21c0753e550d3fa7.jpg') HTTP/1.1" 204 0
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_1e18ea5c92ef151c21c0753e550d3fa7.jpg saved to cache
2026-03-30 09:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36c936c8-3dab-52b4-9d70-f9b93200b40e
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee147c150>
2026-03-30 09:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_c9a0986aa31ada0117daadc7631651a2.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_c9a0986aa31ada0117daadc7631651a2.jpg saved to cache
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 101f649a-7192-5d1d-ac93-2c35ed438fe3
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2869610>
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_79c72dc6ef99508771a407ff5c69bada.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_79c72dc6ef99508771a407ff5c69bada.jpg saved to cache
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36c936c8-3dab-52b4-9d70-f9b93200b40e
2026-03-30 09:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4890b56-462f-5555-b620-ccc0e0be4c7a with identifier: XJ13017
2026-03-30 09:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4890b56-462f-5555-b620-ccc0e0be4c7a with identifier: XJ13017
2026-03-30 09:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4890b56-462f-5555-b620-ccc0e0be4c7a with identifier: XJ13017 to the API
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_19c9f28d7e95f0554edda89c3a1c6cc3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:31:19Z',
 'fuel_type': 'diesel',
 'id': 'd4890b56-462f-5555-b620-ccc0e0be4c7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ13017',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 57481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_19c9f28d7e95f0554edda89c3a1c6cc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_7b4f2ff1a5771f50984693a49cea24db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_1aacbf46d1d55303fa91a55c5703a16c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_0197763816dbf32b81aac7ec44c6f6d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_202ea38c7452bdbefa6b008822ea93f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_887fc4a1f9603e1163951a96d879d2cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_e1b50b81cd1d03f8b9b45fb151fb1b84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_db36dbf84e0a641aa2161e57f18af36c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_840c890d3c412bef4ed7c590b129df58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4890b56-462f-5555-b620-ccc0e0be4c7a/d4890b56-462f-5555-b620-ccc0e0be4c7a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/fb/7afb9309b1f29d8d707c3a03c61300d6/pa/XJ13017_4350b0e3a558ca42a180cbc3f22dee3a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2020}
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ13017%27 HTTP/1.1" 200 None
2026-03-30 09:06:00 [auto1.it] INFO: Saving data for XJ13017: {'created_time': 1774861560.781119, 'last_price_update_time': 1774861560.781131, 'auction_closing_time': 1774971079.0}
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XJ13017') HTTP/1.1" 204 0
2026-03-30 09:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_85d2277cd615af2539dae0f7ef20c0a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_b3554ade6fe40c269ba47e298369a332.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48cdb10>
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff5%252Fdef5eb602979aa6cc9103fd4353702d4%252Fpa%252FKA38100_2ffba7093229f9efd9d9287fd28f8a75.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_2ffba7093229f9efd9d9287fd28f8a75.jpg saved to cache
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36c936c8-3dab-52b4-9d70-f9b93200b40e
2026-03-30 09:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36c936c8-3dab-52b4-9d70-f9b93200b40e, skipping ID generation
2026-03-30 09:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c936c8-3dab-52b4-9d70-f9b93200b40e with scrape type 1
2026-03-30 09:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36c936c8-3dab-52b4-9d70-f9b93200b40e sending to next pipeline
2026-03-30 09:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36c936c8-3dab-52b4-9d70-f9b93200b40e, identifier: KA38100
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26eecd0>
2026-03-30 09:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Ff2%252Fdff2ad56de59a3cf756362c572be4001%252Fpa%252FVE63363_ddb0c345c7dade3172d11312ec0ed3d7.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_ddb0c345c7dade3172d11312ec0ed3d7.jpg saved to cache
2026-03-30 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 593972f5-4dc2-5691-932f-927a12aaf614
2026-03-30 09:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 593972f5-4dc2-5691-932f-927a12aaf614, skipping ID generation
2026-03-30 09:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593972f5-4dc2-5691-932f-927a12aaf614 with scrape type 1
2026-03-30 09:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 593972f5-4dc2-5691-932f-927a12aaf614 sending to next pipeline
2026-03-30 09:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 593972f5-4dc2-5691-932f-927a12aaf614, identifier: VE63363
2026-03-30 09:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36c936c8-3dab-52b4-9d70-f9b93200b40e with identifier: KA38100
2026-03-30 09:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36c936c8-3dab-52b4-9d70-f9b93200b40e with identifier: KA38100
2026-03-30 09:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36c936c8-3dab-52b4-9d70-f9b93200b40e with identifier: KA38100 to the API
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_2ffba7093229f9efd9d9287fd28f8a75.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 83,
 'expiration_date': '2026-03-31T15:58:30Z',
 'fuel_type': 'petrol',
 'id': '36c936c8-3dab-52b4-9d70-f9b93200b40e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA38100',
 'listing': 'auction',
 'location': 'IT, Casoria',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 97230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_850fffff7f74ebff11ca81d4f86ed6d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_2ffba7093229f9efd9d9287fd28f8a75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_79f4b1f63f6c19d742ec52370f3320bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_fd2c888eed4d70f589bb3cf8f0936474.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_adad516daac63ac7e2ca9a0a402da2ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_1e18ea5c92ef151c21c0753e550d3fa7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_10ae64e6cc760a87da9c8f0f9857bfa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_8def168fc1d1fddf6cb188bdd3c5ae0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_79c72dc6ef99508771a407ff5c69bada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36c936c8-3dab-52b4-9d70-f9b93200b40e/36c936c8-3dab-52b4-9d70-f9b93200b40e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f5/def5eb602979aa6cc9103fd4353702d4/pa/KA38100_ec69e08dabb4e1868f7e8192aa982881.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Top',
 'transmission': 'automatic',
 'trim': 'Top',
 'year': 2020}
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA38100%27 HTTP/1.1" 200 None
2026-03-30 09:06:01 [auto1.it] INFO: Saving data for KA38100: {'created_time': 1774861561.741592, 'last_price_update_time': 1774861561.741605, 'auction_closing_time': 1774972710.0}
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KA38100') HTTP/1.1" 204 0
2026-03-30 09:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 593972f5-4dc2-5691-932f-927a12aaf614 with identifier: VE63363
2026-03-30 09:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 593972f5-4dc2-5691-932f-927a12aaf614 with identifier: VE63363
2026-03-30 09:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 593972f5-4dc2-5691-932f-927a12aaf614 with identifier: VE63363 to the API
2026-03-30 09:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_ddb0c345c7dade3172d11312ec0ed3d7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 188,
 'expiration_date': '2026-03-31T15:50:49Z',
 'fuel_type': 'hybrid',
 'id': '593972f5-4dc2-5691-932f-927a12aaf614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE63363',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 87236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_ddb0c345c7dade3172d11312ec0ed3d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_3036c518d7c88344d904bf9451f3ac50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_67afe835352bc5d500746cceda711f60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_3.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 3876672,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_0ce2bdf878b748eac1fc711d4d2752fe.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_c3d2bd960282a51930b68f117d486055.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_d12b14a3031e3981c80db4790b848a08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_c71d8e7eb003a8444d4565fb5a4415d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_7.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 4138301,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_d73b737a6d92a103a743c19e12e57402.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_8.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 3205928,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_2aa197f6cf5bc609add54676e3677c79.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_593972f5-4dc2-5691-932f-927a12aaf614/593972f5-4dc2-5691-932f-927a12aaf614_image_9.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 3846989,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/f2/dff2ad56de59a3cf756362c572be4001/pa/VE63363_7f1626a8bd0d4928fe2981f5c8fd8e89.jpg',
             'Width': 4032}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Intense',
 'transmission': 'automatic',
 'trim': 'Intense',
 'year': 2023}
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE63363%27 HTTP/1.1" 200 None
2026-03-30 09:06:02 [auto1.it] INFO: Saving data for VE63363: {'created_time': 1774861562.90464, 'last_price_update_time': 1774861562.904653, 'auction_closing_time': 1774972249.0}
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VE63363') HTTP/1.1" 204 0
2026-03-30 09:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_1bf6a320b38855ee5708843fafb79d31.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee127c610>
2026-03-30 09:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F93%252F1293d69135268149bc6a41f4e93ba41c%252Fpa%252FPU84761_85d2277cd615af2539dae0f7ef20c0a8.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_85d2277cd615af2539dae0f7ef20c0a8.jpg saved to cache
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 101f649a-7192-5d1d-ac93-2c35ed438fe3
2026-03-30 09:06:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 101f649a-7192-5d1d-ac93-2c35ed438fe3, skipping ID generation
2026-03-30 09:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 101f649a-7192-5d1d-ac93-2c35ed438fe3 with scrape type 1
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 101f649a-7192-5d1d-ac93-2c35ed438fe3 sending to next pipeline
2026-03-30 09:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 101f649a-7192-5d1d-ac93-2c35ed438fe3, identifier: PU84761
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11a9f50>
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_b3554ade6fe40c269ba47e298369a332.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_b3554ade6fe40c269ba47e298369a332.jpg saved to cache
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b222010f-9b3d-5eb1-bba5-e29cffe320c0
2026-03-30 09:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 101f649a-7192-5d1d-ac93-2c35ed438fe3 with identifier: PU84761
2026-03-30 09:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 101f649a-7192-5d1d-ac93-2c35ed438fe3 with identifier: PU84761
2026-03-30 09:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 101f649a-7192-5d1d-ac93-2c35ed438fe3 with identifier: PU84761 to the API
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_85d2277cd615af2539dae0f7ef20c0a8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:57:54Z',
 'fuel_type': 'petrol',
 'id': '101f649a-7192-5d1d-ac93-2c35ed438fe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU84761',
 'listing': 'auction',
 'location': 'IT, Gallarate',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 82921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_85d2277cd615af2539dae0f7ef20c0a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_9feec0eecd206124acc3cb72636271a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_ddb1e1c96f23c1ccbcfebfd83efe7b61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_c9a0986aa31ada0117daadc7631651a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_f0d65751040403b5acf8a9489fe49d32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_1fa68c96d1d8c40d9cf2bad5432fcc59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_465e0b3c4695344b4eda4cd61f9d94ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_d34cd69867084b872010146b605f397d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_cb480be6b37ddb57be3076763aaf7e53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_101f649a-7192-5d1d-ac93-2c35ed438fe3/101f649a-7192-5d1d-ac93-2c35ed438fe3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/93/1293d69135268149bc6a41f4e93ba41c/pa/PU84761_364dd81049745c30753f17a71a3ca8b9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU84761%27 HTTP/1.1" 200 None
2026-03-30 09:06:03 [auto1.it] INFO: Saving data for PU84761: {'created_time': 1774861563.576406, 'last_price_update_time': 1774861563.576415, 'auction_closing_time': 1774972674.0}
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PU84761') HTTP/1.1" 204 0
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee127cf50>
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_1bf6a320b38855ee5708843fafb79d31.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_1bf6a320b38855ee5708843fafb79d31.jpg saved to cache
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab
2026-03-30 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_501b6df75ad8eb0893a89e7f9bf9b088.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_3926201d12a704d70e7b2b726b3a25ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_3739f3247f6e1ec3a03e575107c03da4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_c81781895daababaab16f1092e8f5dc1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_e18183b7891f41333b1ad8c80366e232.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_d48566fd9fbcd29a3eb99c4721ed10ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_10ea6f178f7bce83af25b706d52ac23e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_4566e711b6992eeb1124bc32278b5c5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2825750>
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_501b6df75ad8eb0893a89e7f9bf9b088.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_501b6df75ad8eb0893a89e7f9bf9b088.jpg saved to cache
2026-03-30 09:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab
2026-03-30 09:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12d5cd0>
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fd6%252Faed6a5aab412dcfdf5614626beaf5062%252Fpa%252FZF45749_3926201d12a704d70e7b2b726b3a25ec.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_3926201d12a704d70e7b2b726b3a25ec.jpg saved to cache
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631
2026-03-30 09:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2ab6063-d9f9-50e3-981d-cfc59d9ba631, skipping ID generation
2026-03-30 09:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631 with scrape type 1
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2ab6063-d9f9-50e3-981d-cfc59d9ba631 sending to next pipeline
2026-03-30 09:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c2ab6063-d9f9-50e3-981d-cfc59d9ba631, identifier: ZF45749
2026-03-30 09:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12e6410>
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_3739f3247f6e1ec3a03e575107c03da4.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_3739f3247f6e1ec3a03e575107c03da4.jpg saved to cache
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b222010f-9b3d-5eb1-bba5-e29cffe320c0
2026-03-30 09:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12d3cd0>
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_c81781895daababaab16f1092e8f5dc1.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_c81781895daababaab16f1092e8f5dc1.jpg saved to cache
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b222010f-9b3d-5eb1-bba5-e29cffe320c0
2026-03-30 09:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee108e150>
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F05%252F57052e6668052bd54b4bfa9ae6f7bf81%252Fpa%252FEL85999_e18183b7891f41333b1ad8c80366e232.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_e18183b7891f41333b1ad8c80366e232.jpg saved to cache
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b222010f-9b3d-5eb1-bba5-e29cffe320c0
2026-03-30 09:06:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b222010f-9b3d-5eb1-bba5-e29cffe320c0, skipping ID generation
2026-03-30 09:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b222010f-9b3d-5eb1-bba5-e29cffe320c0 with scrape type 1
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b222010f-9b3d-5eb1-bba5-e29cffe320c0 sending to next pipeline
2026-03-30 09:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b222010f-9b3d-5eb1-bba5-e29cffe320c0, identifier: EL85999
2026-03-30 09:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1397850>
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_d48566fd9fbcd29a3eb99c4721ed10ad.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_d48566fd9fbcd29a3eb99c4721ed10ad.jpg saved to cache
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab
2026-03-30 09:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee280fb50>
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_10ea6f178f7bce83af25b706d52ac23e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_10ea6f178f7bce83af25b706d52ac23e.jpg saved to cache
2026-03-30 09:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab
2026-03-30 09:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c2ab6063-d9f9-50e3-981d-cfc59d9ba631 with identifier: ZF45749
2026-03-30 09:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c2ab6063-d9f9-50e3-981d-cfc59d9ba631 with identifier: ZF45749
2026-03-30 09:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c2ab6063-d9f9-50e3-981d-cfc59d9ba631 with identifier: ZF45749 to the API
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_3926201d12a704d70e7b2b726b3a25ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:08:11Z',
 'fuel_type': 'diesel',
 'id': 'c2ab6063-d9f9-50e3-981d-cfc59d9ba631',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF45749',
 'listing': 'auction',
 'location': 'IT, Catania',
 'make': 'BMW',
 'model': '6er',
 'odometer': 57077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2571663,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_3926201d12a704d70e7b2b726b3a25ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_c6fabacfd3745975a171c5d06f743d9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_9bb9453989b483663b7d45cb8a1b9db6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2391073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_358e18b6aff62cd5cc3647b14619e98d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_5c1245d207005d4c7ea3fce75a6f6cba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_9b73c4f78a9a12f08ddf8f5da0e68115.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370353,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_cfd215ee42d12d6c6394b6de92a123a9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_a51288b6e4c627ab1ebb9c9a860b1cba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_c0359c3e5ed44fe91e784281918248d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2ab6063-d9f9-50e3-981d-cfc59d9ba631/c2ab6063-d9f9-50e3-981d-cfc59d9ba631_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545844,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/d6/aed6a5aab412dcfdf5614626beaf5062/pa/ZF45749_b2ab5274beefbf4e2b069b0db2da1fc7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 6er 630d GT xDrive Luxury Line',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line',
 'year': 2019}
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF45749%27 HTTP/1.1" 200 None
2026-03-30 09:06:05 [auto1.it] INFO: Saving data for ZF45749: {'created_time': 1774861565.888416, 'last_price_update_time': 1774861565.888435, 'auction_closing_time': 1774969691.0}
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF45749') HTTP/1.1" 204 0
2026-03-30 09:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b222010f-9b3d-5eb1-bba5-e29cffe320c0 with identifier: EL85999
2026-03-30 09:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b222010f-9b3d-5eb1-bba5-e29cffe320c0 with identifier: EL85999
2026-03-30 09:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b222010f-9b3d-5eb1-bba5-e29cffe320c0 with identifier: EL85999 to the API
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_e18183b7891f41333b1ad8c80366e232.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:40:41Z',
 'fuel_type': 'diesel',
 'id': 'b222010f-9b3d-5eb1-bba5-e29cffe320c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL85999',
 'listing': 'auction',
 'location': 'IT, Alessandria',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 112111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_b3554ade6fe40c269ba47e298369a332.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2470252,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_e18183b7891f41333b1ad8c80366e232.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2400197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_c81781895daababaab16f1092e8f5dc1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2279914,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_3739f3247f6e1ec3a03e575107c03da4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2589462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_8ea9171d82857534d6751ddff75849db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2564958,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_f3b9c25ff1247348db97fa668a58b42d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_2ecb30cc59493b848dcab473d5338ff9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624958,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_59cbafedbc2c7044b2dbe32ce1da5a21.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2492832,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_d72c1bb988b33c3c987aa2522b8d8294.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b222010f-9b3d-5eb1-bba5-e29cffe320c0/b222010f-9b3d-5eb1-bba5-e29cffe320c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/05/57052e6668052bd54b4bfa9ae6f7bf81/pa/EL85999_5bb7585068a78d2caa24dfcbab88c97e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL85999%27 HTTP/1.1" 200 None
2026-03-30 09:06:06 [auto1.it] INFO: Saving data for EL85999: {'created_time': 1774861566.731765, 'last_price_update_time': 1774861566.731782, 'auction_closing_time': 1774971641.0}
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EL85999') HTTP/1.1" 204 0
2026-03-30 09:06:06 [scrapy.extensions.logstats] INFO: Crawled 78 pages (at 78 pages/min), scraped 39 items (at 39 items/min)
2026-03-30 09:06:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 09:06:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee286d090>
2026-03-30 09:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F2c%252Fd72c9e0f2f29f512f0cf8082ebde32d4%252Fpa%252FXZ58879_4566e711b6992eeb1124bc32278b5c5a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_4566e711b6992eeb1124bc32278b5c5a.jpg saved to cache
2026-03-30 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab
2026-03-30 09:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d8962d3-1ea2-57f9-add0-ddf0179782ab, skipping ID generation
2026-03-30 09:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab with scrape type 1
2026-03-30 09:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d8962d3-1ea2-57f9-add0-ddf0179782ab sending to next pipeline
2026-03-30 09:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d8962d3-1ea2-57f9-add0-ddf0179782ab, identifier: XZ58879
2026-03-30 09:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL94253> (referer: https://www.auto1.com/v1/car-details-view/HL94253/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE75759/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA76603/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW67312/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM86422/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MC43872> (referer: https://www.auto1.com/v1/car-details-view/MC43872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d8962d3-1ea2-57f9-add0-ddf0179782ab with identifier: XZ58879
2026-03-30 09:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d8962d3-1ea2-57f9-add0-ddf0179782ab with identifier: XZ58879
2026-03-30 09:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d8962d3-1ea2-57f9-add0-ddf0179782ab with identifier: XZ58879 to the API
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_4566e711b6992eeb1124bc32278b5c5a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:30:54Z',
 'fuel_type': 'diesel',
 'id': '0d8962d3-1ea2-57f9-add0-ddf0179782ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ58879',
 'listing': 'auction',
 'location': 'IT, Catania',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 158396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_501b6df75ad8eb0893a89e7f9bf9b088.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_4566e711b6992eeb1124bc32278b5c5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_1bf6a320b38855ee5708843fafb79d31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2427616,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_d48566fd9fbcd29a3eb99c4721ed10ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2483626,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_10ea6f178f7bce83af25b706d52ac23e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2566910,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_d5f98c8a590093f3378ccdbd96b8ad23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_53c84fd895fa692bb6ce01059832f0ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_1efa6be9a2b004f3dfbca5f3f8508a13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_f69732e6840281d0b5c9e7bfc4b34c07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d8962d3-1ea2-57f9-add0-ddf0179782ab/0d8962d3-1ea2-57f9-add0-ddf0179782ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/2c/d72c9e0f2f29f512f0cf8082ebde32d4/pa/XZ58879_2c11a75abdadf25e8c31f0146a081f5d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ58879%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [auto1.it] INFO: Saving data for XZ58879: {'created_time': 1774861567.535089, 'last_price_update_time': 1774861567.535105, 'auction_closing_time': 1774971054.0}
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XZ58879') HTTP/1.1" 204 0
2026-03-30 09:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR35596> (referer: https://www.auto1.com/v1/car-details-view/YR35596/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA30561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f3f8a89-23f4-52ae-a3bc-2c801fa85650 with identifier: HL94253
2026-03-30 09:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650 with scrape type 1
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_65d688d74970a4d56170657609b14a98.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_65d688d74970a4d56170657609b14a98.jpg not downloaded yet
2026-03-30 09:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa5fafcc-eb57-52fa-bae8-dba6d0ca4def with identifier: MC43872
2026-03-30 09:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa5fafcc-eb57-52fa-bae8-dba6d0ca4def with scrape type 1
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa5fafcc-eb57-52fa-bae8-dba6d0ca4def
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2b%252F732ba588aa7ff535374439e1ee4a7fde%252Fpa%252FMC43872_7c99d7b751ad99fa5307f81b7f6890c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_7c99d7b751ad99fa5307f81b7f6890c8.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2b%252F732ba588aa7ff535374439e1ee4a7fde%252Fpa%252FMC43872_e07f9236e101be1b5734fd876e2250bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_e07f9236e101be1b5734fd876e2250bf.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2b%252F732ba588aa7ff535374439e1ee4a7fde%252Fpa%252FMC43872_004b192e89147c0f66fea2d10430706a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_004b192e89147c0f66fea2d10430706a.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2b%252F732ba588aa7ff535374439e1ee4a7fde%252Fpa%252FMC43872_1bd49e62d1897b199851e96676b92cfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_1bd49e62d1897b199851e96676b92cfa.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2b%252F732ba588aa7ff535374439e1ee4a7fde%252Fpa%252FMC43872_062493f3b9f4b25317d60a69a6162d9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_062493f3b9f4b25317d60a69a6162d9b.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2b%252F732ba588aa7ff535374439e1ee4a7fde%252Fpa%252FMC43872_ddb9d39673880ff4330138f6ac69f752.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_ddb9d39673880ff4330138f6ac69f752.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2b%252F732ba588aa7ff535374439e1ee4a7fde%252Fpa%252FMC43872_39e93ddfea281acaac4b6caa98892fd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_39e93ddfea281acaac4b6caa98892fd8.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2b%252F732ba588aa7ff535374439e1ee4a7fde%252Fpa%252FMC43872_358e4ddd84a2d997e4cbb1155a5c7bc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_358e4ddd84a2d997e4cbb1155a5c7bc9.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2b%252F732ba588aa7ff535374439e1ee4a7fde%252Fpa%252FMC43872_d804039246314f3d683548e11b103f49.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_d804039246314f3d683548e11b103f49.jpg already downloaded
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2b%252F732ba588aa7ff535374439e1ee4a7fde%252Fpa%252FMC43872_1c367a43d5678d4e2a4092463d286fe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_1c367a43d5678d4e2a4092463d286fe4.jpg already downloaded
2026-03-30 09:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa5fafcc-eb57-52fa-bae8-dba6d0ca4def, identifier: MC43872
2026-03-30 09:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa5fafcc-eb57-52fa-bae8-dba6d0ca4def with identifier: MC43872
2026-03-30 09:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa5fafcc-eb57-52fa-bae8-dba6d0ca4def with identifier: MC43872
2026-03-30 09:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa5fafcc-eb57-52fa-bae8-dba6d0ca4def with identifier: MC43872 to the API
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MC43872>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:41:47Z',
 'fuel_type': 'petrol',
 'id': 'fa5fafcc-eb57-52fa-bae8-dba6d0ca4def',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC43872',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 198288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_7c99d7b751ad99fa5307f81b7f6890c8.jpg',
                'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_e07f9236e101be1b5734fd876e2250bf.jpg',
                'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_004b192e89147c0f66fea2d10430706a.jpg',
                'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_1bd49e62d1897b199851e96676b92cfa.jpg',
                'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_062493f3b9f4b25317d60a69a6162d9b.jpg',
                'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_ddb9d39673880ff4330138f6ac69f752.jpg',
                'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_39e93ddfea281acaac4b6caa98892fd8.jpg',
                'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_358e4ddd84a2d997e4cbb1155a5c7bc9.jpg',
                'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_d804039246314f3d683548e11b103f49.jpg',
                'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_1c367a43d5678d4e2a4092463d286fe4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa5fafcc-eb57-52fa-bae8-dba6d0ca4def/fa5fafcc-eb57-52fa-bae8-dba6d0ca4def_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_7c99d7b751ad99fa5307f81b7f6890c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa5fafcc-eb57-52fa-bae8-dba6d0ca4def/fa5fafcc-eb57-52fa-bae8-dba6d0ca4def_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_e07f9236e101be1b5734fd876e2250bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa5fafcc-eb57-52fa-bae8-dba6d0ca4def/fa5fafcc-eb57-52fa-bae8-dba6d0ca4def_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_004b192e89147c0f66fea2d10430706a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa5fafcc-eb57-52fa-bae8-dba6d0ca4def/fa5fafcc-eb57-52fa-bae8-dba6d0ca4def_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_1bd49e62d1897b199851e96676b92cfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa5fafcc-eb57-52fa-bae8-dba6d0ca4def/fa5fafcc-eb57-52fa-bae8-dba6d0ca4def_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_062493f3b9f4b25317d60a69a6162d9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa5fafcc-eb57-52fa-bae8-dba6d0ca4def/fa5fafcc-eb57-52fa-bae8-dba6d0ca4def_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_ddb9d39673880ff4330138f6ac69f752.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa5fafcc-eb57-52fa-bae8-dba6d0ca4def/fa5fafcc-eb57-52fa-bae8-dba6d0ca4def_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_39e93ddfea281acaac4b6caa98892fd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa5fafcc-eb57-52fa-bae8-dba6d0ca4def/fa5fafcc-eb57-52fa-bae8-dba6d0ca4def_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_358e4ddd84a2d997e4cbb1155a5c7bc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa5fafcc-eb57-52fa-bae8-dba6d0ca4def/fa5fafcc-eb57-52fa-bae8-dba6d0ca4def_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_d804039246314f3d683548e11b103f49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa5fafcc-eb57-52fa-bae8-dba6d0ca4def/fa5fafcc-eb57-52fa-bae8-dba6d0ca4def_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2b/732ba588aa7ff535374439e1ee4a7fde/pa/MC43872_1c367a43d5678d4e2a4092463d286fe4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC43872%27 HTTP/1.1" 200 None
2026-03-30 09:06:08 [auto1.it] INFO: Saving data for MC43872: {'created_time': 1774861568.463646, 'last_price_update_time': 1774861568.46366, 'auction_closing_time': 1774971707.0}
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MC43872') HTTP/1.1" 204 0
2026-03-30 09:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_3621977bad8ee073e8f76fad982060f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_0601a884f36414c09b06e534aba7c7af.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_3d865a26722c4203b111ad8040e9501c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_1b92cc4bb7073f64caa86851198af20c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_8f1f341ffb85a62b3fe011ad1643db8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_17234373d792ed77a8b3b4efba087325.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_17234373d792ed77a8b3b4efba087325.jpg not downloaded yet
2026-03-30 09:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_c144b91af445a453b2cd1ad27b1e43b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_6c83138e5e98192eb039417032c7aaf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_f793f1d9f08f92e3d87e5af6c0faa8e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_d2b0ccd2ee0911bd14f4c8e2a225d218.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_d2b0ccd2ee0911bd14f4c8e2a225d218.jpg not downloaded yet
2026-03-30 09:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdab4158-2154-5b1a-9490-057db1962860 with identifier: YR35596
2026-03-30 09:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdab4158-2154-5b1a-9490-057db1962860 with scrape type 1
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdab4158-2154-5b1a-9490-057db1962860
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_3de10d132656d25a2322b075fa0fe586.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_3de10d132656d25a2322b075fa0fe586.jpg not downloaded yet
2026-03-30 09:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_59586913942965f1f1900df91f30fcae.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_3eb3f63075dc4b0f47583a5fe54dd9ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_3eb3f63075dc4b0f47583a5fe54dd9ce.jpg not downloaded yet
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_907f125fcce80a18eb5d4acdcba12d5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_907f125fcce80a18eb5d4acdcba12d5f.jpg not downloaded yet
2026-03-30 09:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_65d688d74970a4d56170657609b14a98.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_bad6e421149cbf6775c0e33001c44b1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_bad6e421149cbf6775c0e33001c44b1d.jpg not downloaded yet
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_c997b3372d1c85fd31030e16bb49601c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_c997b3372d1c85fd31030e16bb49601c.jpg not downloaded yet
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1199cd0>
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_3621977bad8ee073e8f76fad982060f8.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_3621977bad8ee073e8f76fad982060f8.jpg saved to cache
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8513602-c95f-5916-a9c6-6b1300653209
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2507d10>
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F75%252F797543f9aeb5bbff4dd263272da2a47c%252Fpa%252FSE55606_0601a884f36414c09b06e534aba7c7af.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_0601a884f36414c09b06e534aba7c7af.jpg saved to cache
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6272d7c5-299a-5de7-be43-71c33c5b12c3
2026-03-30 09:06:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6272d7c5-299a-5de7-be43-71c33c5b12c3, skipping ID generation
2026-03-30 09:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6272d7c5-299a-5de7-be43-71c33c5b12c3 with scrape type 1
2026-03-30 09:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6272d7c5-299a-5de7-be43-71c33c5b12c3 sending to next pipeline
2026-03-30 09:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6272d7c5-299a-5de7-be43-71c33c5b12c3, identifier: SE55606
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1440ad0>
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_3d865a26722c4203b111ad8040e9501c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_3d865a26722c4203b111ad8040e9501c.jpg saved to cache
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13fd750>
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_1b92cc4bb7073f64caa86851198af20c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_1b92cc4bb7073f64caa86851198af20c.jpg saved to cache
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25669d0>
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_8f1f341ffb85a62b3fe011ad1643db8e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_8f1f341ffb85a62b3fe011ad1643db8e.jpg saved to cache
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12ea7d0>
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8f0a463-597b-52a6-bc4f-bd27dee6dd93/a8f0a463-597b-52a6-bc4f-bd27dee6dd93_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fef%252F73ef2856247e87792dc568905ac327e4%252Fpa%252FLU79948_c144b91af445a453b2cd1ad27b1e43b9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_c144b91af445a453b2cd1ad27b1e43b9.jpg saved to cache
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8f0a463-597b-52a6-bc4f-bd27dee6dd93
2026-03-30 09:06:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8f0a463-597b-52a6-bc4f-bd27dee6dd93, skipping ID generation
2026-03-30 09:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8f0a463-597b-52a6-bc4f-bd27dee6dd93 with scrape type 1
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8f0a463-597b-52a6-bc4f-bd27dee6dd93 sending to next pipeline
2026-03-30 09:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a8f0a463-597b-52a6-bc4f-bd27dee6dd93, identifier: LU79948
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1207790>
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_6c83138e5e98192eb039417032c7aaf3.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_6c83138e5e98192eb039417032c7aaf3.jpg saved to cache
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8513602-c95f-5916-a9c6-6b1300653209
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25345d0>
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_f793f1d9f08f92e3d87e5af6c0faa8e9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_f793f1d9f08f92e3d87e5af6c0faa8e9.jpg saved to cache
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-03-30 09:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_68cecabe5f1de07df450932f70abfac9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_cc30d52ab3f2aecff3f437e43fa3733c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_cc30d52ab3f2aecff3f437e43fa3733c.jpg not downloaded yet
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_8ff8c98a6bd2763c5dba63e9991c851e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_8ff8c98a6bd2763c5dba63e9991c851e.jpg not downloaded yet
2026-03-30 09:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6272d7c5-299a-5de7-be43-71c33c5b12c3 with identifier: SE55606
2026-03-30 09:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6272d7c5-299a-5de7-be43-71c33c5b12c3 with identifier: SE55606
2026-03-30 09:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6272d7c5-299a-5de7-be43-71c33c5b12c3 with identifier: SE55606 to the API
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_0601a884f36414c09b06e534aba7c7af.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:34:30Z',
 'fuel_type': 'diesel',
 'id': '6272d7c5-299a-5de7-be43-71c33c5b12c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE55606',
 'listing': 'auction',
 'location': 'IT, Treviso',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 306035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_44b06042015f989a743d2f7479723fef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_0601a884f36414c09b06e534aba7c7af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_576dadb994b4338c8e6fc8f41ff539ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_2bfb089509e36bb8edd2bb299258f227.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_2484b19eb9805fa727d826f8510d8bc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_cc50a6599404948e4ac33d5341776037.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_bf35faa0dc4b8fb22dc23192486a825d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_3e0e707ac2f5dad97f2b007db0c7319e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_073c298e696d1042e52355e962617032.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6272d7c5-299a-5de7-be43-71c33c5b12c3/6272d7c5-299a-5de7-be43-71c33c5b12c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/75/797543f9aeb5bbff4dd263272da2a47c/pa/SE55606_c5a202f28aa0a5f1a8372770323ed85b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2012}
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE55606%27 HTTP/1.1" 200 None
2026-03-30 09:06:09 [auto1.it] INFO: Saving data for SE55606: {'created_time': 1774861569.866779, 'last_price_update_time': 1774861569.866791, 'auction_closing_time': 1774971270.0}
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SE55606') HTTP/1.1" 204 0
2026-03-30 09:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a8f0a463-597b-52a6-bc4f-bd27dee6dd93 with identifier: LU79948
2026-03-30 09:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a8f0a463-597b-52a6-bc4f-bd27dee6dd93 with identifier: LU79948
2026-03-30 09:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a8f0a463-597b-52a6-bc4f-bd27dee6dd93 with identifier: LU79948 to the API
2026-03-30 09:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_c144b91af445a453b2cd1ad27b1e43b9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:17:10Z',
 'fuel_type': 'diesel',
 'id': 'a8f0a463-597b-52a6-bc4f-bd27dee6dd93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU79948',
 'listing': 'auction',
 'location': 'IT, Creazzo VI',
 'make': 'Fiat',
 'model': '500',
 'odometer': 194686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8f0a463-597b-52a6-bc4f-bd27dee6dd93/a8f0a463-597b-52a6-bc4f-bd27dee6dd93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_6b21e84042d60edce5097baa97e929aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8f0a463-597b-52a6-bc4f-bd27dee6dd93/a8f0a463-597b-52a6-bc4f-bd27dee6dd93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_c144b91af445a453b2cd1ad27b1e43b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8f0a463-597b-52a6-bc4f-bd27dee6dd93/a8f0a463-597b-52a6-bc4f-bd27dee6dd93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_df344cf59b1d93558d7b847153b60c53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8f0a463-597b-52a6-bc4f-bd27dee6dd93/a8f0a463-597b-52a6-bc4f-bd27dee6dd93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_e699343e3bdf3b16a498a232563dbfd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8f0a463-597b-52a6-bc4f-bd27dee6dd93/a8f0a463-597b-52a6-bc4f-bd27dee6dd93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/ef/73ef2856247e87792dc568905ac327e4/pa/LU79948_d18433039f5ecf1ac1862d84d898d917.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.3 JTD Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU79948%27 HTTP/1.1" 200 None
2026-03-30 09:06:10 [auto1.it] INFO: Saving data for LU79948: {'created_time': 1774861570.285101, 'last_price_update_time': 1774861570.285114, 'auction_closing_time': 1774970230.0}
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU79948') HTTP/1.1" 204 0
2026-03-30 09:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_956210d09addecacee8e76e6c16b69c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26b5c10>
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_59586913942965f1f1900df91f30fcae.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_59586913942965f1f1900df91f30fcae.jpg saved to cache
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8513602-c95f-5916-a9c6-6b1300653209
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2735e90>
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_65d688d74970a4d56170657609b14a98.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_65d688d74970a4d56170657609b14a98.jpg saved to cache
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650
2026-03-30 09:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_3de10d132656d25a2322b075fa0fe586.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_1edf51b1dff81a7572b2b42f35a94f7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_1edf51b1dff81a7572b2b42f35a94f7e.jpg not downloaded yet
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_bd5ef8c9794b23ef9ef059ff0eef263d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_bd5ef8c9794b23ef9ef059ff0eef263d.jpg not downloaded yet
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2755390>
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F41%252F9e41e4a940bb85fc2a3b242a9ac6ccba%252Fpa%252FAX59226_68cecabe5f1de07df450932f70abfac9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_68cecabe5f1de07df450932f70abfac9.jpg saved to cache
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1
2026-03-30 09:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1, skipping ID generation
2026-03-30 09:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1 with scrape type 1
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1 sending to next pipeline
2026-03-30 09:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1, identifier: AX59226
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_6a8619c92adf6ab4683f80755920fec3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_6a8619c92adf6ab4683f80755920fec3.jpg not downloaded yet
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_96c3c3851e0e7f3d04b1d4b28f5a191a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_96c3c3851e0e7f3d04b1d4b28f5a191a.jpg not downloaded yet
2026-03-30 09:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1 with identifier: AX59226
2026-03-30 09:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1 with identifier: AX59226
2026-03-30 09:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3766da09-d5cc-5fbd-83eb-ef3db0a5aba1 with identifier: AX59226 to the API
2026-03-30 09:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_68cecabe5f1de07df450932f70abfac9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:31:19Z',
 'fuel_type': 'diesel',
 'id': '3766da09-d5cc-5fbd-83eb-ef3db0a5aba1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX59226',
 'listing': 'auction',
 'location': 'IT, Parma',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 238478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_956d5bc12cef9d02164d1b1b70661fcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_7eea9d4341d0e6aac73890918272bed1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_68cecabe5f1de07df450932f70abfac9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_3d865a26722c4203b111ad8040e9501c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_8f1f341ffb85a62b3fe011ad1643db8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_3d8e4c215ed3521dc725e51e23295203.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_7fb85def24f60fb90ddb7e810c7934bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_39ee4ef072b1e039827e8c925cad57eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_30ea97c8334e4cd2e9bdc7c2d1386f68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3766da09-d5cc-5fbd-83eb-ef3db0a5aba1/3766da09-d5cc-5fbd-83eb-ef3db0a5aba1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/41/9e41e4a940bb85fc2a3b242a9ac6ccba/pa/AX59226_fd02a2aec009a614dd1a0bf7df5c8822.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Cosmo ecoFlex',
 'transmission': 'manual',
 'trim': 'Cosmo ecoFlex',
 'year': 2016}
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX59226%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [auto1.it] INFO: Saving data for AX59226: {'created_time': 1774861572.164577, 'last_price_update_time': 1774861572.164592, 'auction_closing_time': 1774971079.0}
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AX59226') HTTP/1.1" 204 0
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee141a890>
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e60e8b2c-2ddc-5c21-8df5-23eca2c90987/e60e8b2c-2ddc-5c21-8df5-23eca2c90987_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5ab3fe722ec37ff8b79bc748e4bbce%252Fpa%252FFD34465_956210d09addecacee8e76e6c16b69c2.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_956210d09addecacee8e76e6c16b69c2.jpg saved to cache
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e60e8b2c-2ddc-5c21-8df5-23eca2c90987
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_bad6e421149cbf6775c0e33001c44b1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_8ff8c98a6bd2763c5dba63e9991c851e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_c997b3372d1c85fd31030e16bb49601c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_11fca674f050152021dfe2548990a380.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_11fca674f050152021dfe2548990a380.jpg not downloaded yet
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_c09b20774486d02ddf692bb7020b52f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_c09b20774486d02ddf692bb7020b52f4.jpg not downloaded yet
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26c7150>
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_3de10d132656d25a2322b075fa0fe586.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_3de10d132656d25a2322b075fa0fe586.jpg saved to cache
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdab4158-2154-5b1a-9490-057db1962860
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV17911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG27064> (referer: https://www.auto1.com/v1/car-details-view/FG27064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM86422> (referer: https://www.auto1.com/v1/car-details-view/FM86422/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG78231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC63187/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR86104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR95165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_1e74be975d9597102deb3e9e75136802.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_1e74be975d9597102deb3e9e75136802.jpg not downloaded yet
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_3a7794de5199ead1f3d3689c01910c30.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_3a7794de5199ead1f3d3689c01910c30.jpg not downloaded yet
2026-03-30 09:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26b4350>
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_bad6e421149cbf6775c0e33001c44b1d.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_bad6e421149cbf6775c0e33001c44b1d.jpg saved to cache
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26f3a50>
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_8ff8c98a6bd2763c5dba63e9991c851e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_8ff8c98a6bd2763c5dba63e9991c851e.jpg saved to cache
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdab4158-2154-5b1a-9490-057db1962860
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26754d0>
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_c997b3372d1c85fd31030e16bb49601c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_c997b3372d1c85fd31030e16bb49601c.jpg saved to cache
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdab4158-2154-5b1a-9490-057db1962860
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_1550f2326c28980126828a8715b0301c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_1550f2326c28980126828a8715b0301c.jpg not downloaded yet
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_6a8619c92adf6ab4683f80755920fec3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_96c3c3851e0e7f3d04b1d4b28f5a191a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_54b98688d1d22af48038c5ca19c3f324.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_54b98688d1d22af48038c5ca19c3f324.jpg not downloaded yet
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_11fca674f050152021dfe2548990a380.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:12 [auto1.it] INFO: Channel: 24h | Page: 4 | totalHits: 3304 | hits on page: 40
2026-03-30 09:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aed58a16-af46-53f7-b4dc-119a5bc2b50d with identifier: FG27064
2026-03-30 09:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aed58a16-af46-53f7-b4dc-119a5bc2b50d with scrape type 1
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aed58a16-af46-53f7-b4dc-119a5bc2b50d
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_594ac82f1b38b06c926956517ceee651.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_594ac82f1b38b06c926956517ceee651.jpg not downloaded yet
2026-03-30 09:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dafcdefe-4b13-5526-b59f-a607e332a01a with identifier: FM86422
2026-03-30 09:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dafcdefe-4b13-5526-b59f-a607e332a01a with scrape type 1
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dafcdefe-4b13-5526-b59f-a607e332a01a
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa9%252Ff8a9ab083908c4d5bea74e53872d9b8a%252Fpa%252FFM86422_05eca0ddef4541a7464ea85dee9b933d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_05eca0ddef4541a7464ea85dee9b933d.jpg already downloaded
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa9%252Ff8a9ab083908c4d5bea74e53872d9b8a%252Fpa%252FFM86422_4ad6a680b8b67ea7e15ac09f141e472b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_4ad6a680b8b67ea7e15ac09f141e472b.jpg already downloaded
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa9%252Ff8a9ab083908c4d5bea74e53872d9b8a%252Fpa%252FFM86422_249fc04d5063882540f26edc45d7604b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_249fc04d5063882540f26edc45d7604b.jpg already downloaded
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa9%252Ff8a9ab083908c4d5bea74e53872d9b8a%252Fpa%252FFM86422_2b5a9fbdd69ae20ad32d75c58aabae76.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_2b5a9fbdd69ae20ad32d75c58aabae76.jpg already downloaded
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa9%252Ff8a9ab083908c4d5bea74e53872d9b8a%252Fpa%252FFM86422_e50d42280d8655012bb0f9175b9ba0fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_e50d42280d8655012bb0f9175b9ba0fc.jpg already downloaded
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa9%252Ff8a9ab083908c4d5bea74e53872d9b8a%252Fpa%252FFM86422_bd928a737836ab7dbb7c513592f3d5cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_bd928a737836ab7dbb7c513592f3d5cb.jpg already downloaded
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa9%252Ff8a9ab083908c4d5bea74e53872d9b8a%252Fpa%252FFM86422_1c8a42d68c691ada7a1349057e8060ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_1c8a42d68c691ada7a1349057e8060ad.jpg already downloaded
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa9%252Ff8a9ab083908c4d5bea74e53872d9b8a%252Fpa%252FFM86422_3d7d271f5fad377e9a807f578e7c027d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_3d7d271f5fad377e9a807f578e7c027d.jpg already downloaded
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa9%252Ff8a9ab083908c4d5bea74e53872d9b8a%252Fpa%252FFM86422_2805d48195584b502efa0dac61a5672a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_2805d48195584b502efa0dac61a5672a.jpg already downloaded
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fa9%252Ff8a9ab083908c4d5bea74e53872d9b8a%252Fpa%252FFM86422_0ebd13ebec70818b444e73e425f50bad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_0ebd13ebec70818b444e73e425f50bad.jpg already downloaded
2026-03-30 09:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dafcdefe-4b13-5526-b59f-a607e332a01a, identifier: FM86422
2026-03-30 09:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_3eb3f63075dc4b0f47583a5fe54dd9ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dafcdefe-4b13-5526-b59f-a607e332a01a with identifier: FM86422
2026-03-30 09:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dafcdefe-4b13-5526-b59f-a607e332a01a with identifier: FM86422
2026-03-30 09:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dafcdefe-4b13-5526-b59f-a607e332a01a with identifier: FM86422 to the API
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FM86422>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:15:11Z',
 'fuel_type': 'diesel',
 'id': 'dafcdefe-4b13-5526-b59f-a607e332a01a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM86422',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 176162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_05eca0ddef4541a7464ea85dee9b933d.jpg',
                'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_4ad6a680b8b67ea7e15ac09f141e472b.jpg',
                'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_249fc04d5063882540f26edc45d7604b.jpg',
                'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_2b5a9fbdd69ae20ad32d75c58aabae76.jpg',
                'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_e50d42280d8655012bb0f9175b9ba0fc.jpg',
                'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_bd928a737836ab7dbb7c513592f3d5cb.jpg',
                'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_1c8a42d68c691ada7a1349057e8060ad.jpg',
                'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_3d7d271f5fad377e9a807f578e7c027d.jpg',
                'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_2805d48195584b502efa0dac61a5672a.jpg',
                'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_0ebd13ebec70818b444e73e425f50bad.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafcdefe-4b13-5526-b59f-a607e332a01a/dafcdefe-4b13-5526-b59f-a607e332a01a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2583123,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_05eca0ddef4541a7464ea85dee9b933d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafcdefe-4b13-5526-b59f-a607e332a01a/dafcdefe-4b13-5526-b59f-a607e332a01a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_4ad6a680b8b67ea7e15ac09f141e472b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafcdefe-4b13-5526-b59f-a607e332a01a/dafcdefe-4b13-5526-b59f-a607e332a01a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_249fc04d5063882540f26edc45d7604b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafcdefe-4b13-5526-b59f-a607e332a01a/dafcdefe-4b13-5526-b59f-a607e332a01a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2526974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_2b5a9fbdd69ae20ad32d75c58aabae76.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafcdefe-4b13-5526-b59f-a607e332a01a/dafcdefe-4b13-5526-b59f-a607e332a01a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2565775,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_e50d42280d8655012bb0f9175b9ba0fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafcdefe-4b13-5526-b59f-a607e332a01a/dafcdefe-4b13-5526-b59f-a607e332a01a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_bd928a737836ab7dbb7c513592f3d5cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafcdefe-4b13-5526-b59f-a607e332a01a/dafcdefe-4b13-5526-b59f-a607e332a01a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_1c8a42d68c691ada7a1349057e8060ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafcdefe-4b13-5526-b59f-a607e332a01a/dafcdefe-4b13-5526-b59f-a607e332a01a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_3d7d271f5fad377e9a807f578e7c027d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafcdefe-4b13-5526-b59f-a607e332a01a/dafcdefe-4b13-5526-b59f-a607e332a01a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_2805d48195584b502efa0dac61a5672a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dafcdefe-4b13-5526-b59f-a607e332a01a/dafcdefe-4b13-5526-b59f-a607e332a01a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2595091,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/a9/f8a9ab083908c4d5bea74e53872d9b8a/pa/FM86422_0ebd13ebec70818b444e73e425f50bad.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 40 TDI quattro S Line Edition',
 'transmission': 'automatic',
 'trim': 'quattro S Line Edition',
 'year': 2019}
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM86422%27 HTTP/1.1" 200 None
2026-03-30 09:06:13 [auto1.it] INFO: Saving data for FM86422: {'created_time': 1774861573.484702, 'last_price_update_time': 1774861573.484712, 'auction_closing_time': 1774970111.0}
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FM86422') HTTP/1.1" 204 0
2026-03-30 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_d2b0ccd2ee0911bd14f4c8e2a225d218.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_c09b20774486d02ddf692bb7020b52f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_1edf51b1dff81a7572b2b42f35a94f7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_cc30d52ab3f2aecff3f437e43fa3733c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_bd5ef8c9794b23ef9ef059ff0eef263d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:13 [auto1.it] INFO: Found listing with ID: UW57613
2026-03-30 09:06:13 [auto1.it] INFO: Found listing with ID: KJ64307
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ64307%27 HTTP/1.1" 200 None
2026-03-30 09:06:13 [auto1.it] INFO: Scrape type for KJ64307: 1
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_241890a9d7100599a7447b11f8c16ea8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_241890a9d7100599a7447b11f8c16ea8.jpg not downloaded yet
2026-03-30 09:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_17234373d792ed77a8b3b4efba087325.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:13 [auto1.it] INFO: Found listing with ID: FL99970
2026-03-30 09:06:13 [auto1.it] INFO: Found listing with ID: NF28136
2026-03-30 09:06:13 [auto1.it] INFO: Found listing with ID: BB99358
2026-03-30 09:06:13 [auto1.it] INFO: Found listing with ID: BW52092
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW52092%27 HTTP/1.1" 200 None
2026-03-30 09:06:13 [auto1.it] INFO: Scrape type for BW52092: 1
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_76481e8b4f64cb3742ad6f1a45334233.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_76481e8b4f64cb3742ad6f1a45334233.jpg not downloaded yet
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48cbc90>
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_6a8619c92adf6ab4683f80755920fec3.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_6a8619c92adf6ab4683f80755920fec3.jpg saved to cache
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee258d010>
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_96c3c3851e0e7f3d04b1d4b28f5a191a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_96c3c3851e0e7f3d04b1d4b28f5a191a.jpg saved to cache
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdab4158-2154-5b1a-9490-057db1962860
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25f4b10>
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_11fca674f050152021dfe2548990a380.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_11fca674f050152021dfe2548990a380.jpg saved to cache
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1452ed0>
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_3eb3f63075dc4b0f47583a5fe54dd9ce.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_3eb3f63075dc4b0f47583a5fe54dd9ce.jpg saved to cache
2026-03-30 09:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1294d50>
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_d2b0ccd2ee0911bd14f4c8e2a225d218.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_d2b0ccd2ee0911bd14f4c8e2a225d218.jpg saved to cache
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee132f3d0>
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_c09b20774486d02ddf692bb7020b52f4.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_c09b20774486d02ddf692bb7020b52f4.jpg saved to cache
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdab4158-2154-5b1a-9490-057db1962860
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2633490>
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_1edf51b1dff81a7572b2b42f35a94f7e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_1edf51b1dff81a7572b2b42f35a94f7e.jpg saved to cache
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee132ce50>
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_cc30d52ab3f2aecff3f437e43fa3733c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_cc30d52ab3f2aecff3f437e43fa3733c.jpg saved to cache
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11a2250>
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_bd5ef8c9794b23ef9ef059ff0eef263d.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_bd5ef8c9794b23ef9ef059ff0eef263d.jpg saved to cache
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdab4158-2154-5b1a-9490-057db1962860
2026-03-30 09:06:14 [auto1.it] INFO: Found listing with ID: CF64613
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF64613%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [auto1.it] INFO: Scrape type for CF64613: 2
2026-03-30 09:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 435ec311-6fad-5ddb-846e-71a9133a044b with identifier: CF64613
2026-03-30 09:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 435ec311-6fad-5ddb-846e-71a9133a044b with scrape type 2
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 435ec311-6fad-5ddb-846e-71a9133a044b with scrape type 2
2026-03-30 09:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 435ec311-6fad-5ddb-846e-71a9133a044b, identifier: CF64613
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_b3d79139b4c4bc22c196e5accfac8d1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_b3d79139b4c4bc22c196e5accfac8d1b.jpg not downloaded yet
2026-03-30 09:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_1550f2326c28980126828a8715b0301c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_594ac82f1b38b06c926956517ceee651.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_1e74be975d9597102deb3e9e75136802.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 435ec311-6fad-5ddb-846e-71a9133a044b with identifier: CF64613
2026-03-30 09:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 435ec311-6fad-5ddb-846e-71a9133a044b with identifier: CF64613
2026-03-30 09:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 435ec311-6fad-5ddb-846e-71a9133a044b with identifier: CF64613 to the API
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:22:06Z',
 'fuel_type': 'diesel',
 'id': '435ec311-6fad-5ddb-846e-71a9133a044b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF64613',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 77937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF64613%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [auto1.it] INFO: Saving data for CF64613: {'auction_closing_time': 1774970526.0, 'created_time': 1772177105.34136, 'last_price_update_time': 1774861574.755744}
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CF64613') HTTP/1.1" 204 0
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11a3a90>
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_17234373d792ed77a8b3b4efba087325.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_17234373d792ed77a8b3b4efba087325.jpg saved to cache
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650
2026-03-30 09:06:14 [auto1.it] INFO: Found listing with ID: TF93411
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF93411%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [auto1.it] INFO: Scrape type for TF93411: 1
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_0398caacea2e7b0de8b92f874fa98963.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_0398caacea2e7b0de8b92f874fa98963.jpg not downloaded yet
2026-03-30 09:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_241890a9d7100599a7447b11f8c16ea8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:14 [auto1.it] INFO: Found listing with ID: LX38912
2026-03-30 09:06:14 [auto1.it] INFO: Found listing with ID: JZ25588
2026-03-30 09:06:14 [auto1.it] INFO: Found listing with ID: YU05925
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU05925%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [auto1.it] INFO: Scrape type for YU05925: 1
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_114e2adbbc48926ad7345d9bb63d2147.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_114e2adbbc48926ad7345d9bb63d2147.jpg not downloaded yet
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee128c490>
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_1550f2326c28980126828a8715b0301c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_1550f2326c28980126828a8715b0301c.jpg saved to cache
2026-03-30 09:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdab4158-2154-5b1a-9490-057db1962860
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee109bd10>
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_594ac82f1b38b06c926956517ceee651.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_594ac82f1b38b06c926956517ceee651.jpg saved to cache
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aed58a16-af46-53f7-b4dc-119a5bc2b50d
2026-03-30 09:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1225dd0>
2026-03-30 09:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fe4%252F15e45b19415253f38f6abb6a42cb3681%252Fpa%252FHL94253_1e74be975d9597102deb3e9e75136802.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_1e74be975d9597102deb3e9e75136802.jpg saved to cache
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650
2026-03-30 09:06:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5f3f8a89-23f4-52ae-a3bc-2c801fa85650, skipping ID generation
2026-03-30 09:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650 with scrape type 1
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5f3f8a89-23f4-52ae-a3bc-2c801fa85650 sending to next pipeline
2026-03-30 09:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5f3f8a89-23f4-52ae-a3bc-2c801fa85650, identifier: HL94253
2026-03-30 09:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5f3f8a89-23f4-52ae-a3bc-2c801fa85650 with identifier: HL94253
2026-03-30 09:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5f3f8a89-23f4-52ae-a3bc-2c801fa85650 with identifier: HL94253
2026-03-30 09:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5f3f8a89-23f4-52ae-a3bc-2c801fa85650 with identifier: HL94253 to the API
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_1e74be975d9597102deb3e9e75136802.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:21:51Z',
 'fuel_type': 'diesel',
 'id': '5f3f8a89-23f4-52ae-a3bc-2c801fa85650',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL94253',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 136767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_65d688d74970a4d56170657609b14a98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_17234373d792ed77a8b3b4efba087325.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_d2b0ccd2ee0911bd14f4c8e2a225d218.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_3eb3f63075dc4b0f47583a5fe54dd9ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_bad6e421149cbf6775c0e33001c44b1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_cc30d52ab3f2aecff3f437e43fa3733c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_1edf51b1dff81a7572b2b42f35a94f7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_6a8619c92adf6ab4683f80755920fec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_11fca674f050152021dfe2548990a380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3f8a89-23f4-52ae-a3bc-2c801fa85650/5f3f8a89-23f4-52ae-a3bc-2c801fa85650_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/e4/15e45b19415253f38f6abb6a42cb3681/pa/HL94253_1e74be975d9597102deb3e9e75136802.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport D150 R-Dynamic S AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S AWD',
 'year': 2020}
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL94253%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [auto1.it] INFO: Saving data for HL94253: {'created_time': 1774861575.625345, 'last_price_update_time': 1774861575.625356, 'auction_closing_time': 1774970511.0}
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HL94253') HTTP/1.1" 204 0
2026-03-30 09:06:15 [auto1.it] INFO: Found listing with ID: MA72760
2026-03-30 09:06:15 [auto1.it] INFO: Found listing with ID: EC41125
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC41125%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [auto1.it] INFO: Scrape type for EC41125: 1
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_3994812cc78edca177ea8c637006da6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_3994812cc78edca177ea8c637006da6d.jpg not downloaded yet
2026-03-30 09:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_76481e8b4f64cb3742ad6f1a45334233.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee108f250>
2026-03-30 09:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_241890a9d7100599a7447b11f8c16ea8.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_241890a9d7100599a7447b11f8c16ea8.jpg saved to cache
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aed58a16-af46-53f7-b4dc-119a5bc2b50d
2026-03-30 09:06:15 [auto1.it] INFO: Found listing with ID: JU77686
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU77686%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [auto1.it] INFO: Scrape type for JU77686: 1
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_5e9aad1dce9a29249d6e4e11f1d11ac6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_5e9aad1dce9a29249d6e4e11f1d11ac6.jpg not downloaded yet
2026-03-30 09:06:15 [auto1.it] INFO: Found listing with ID: YM60630
2026-03-30 09:06:15 [auto1.it] INFO: Found listing with ID: AL20589
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL20589%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [auto1.it] INFO: Scrape type for AL20589: 1
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_68614b3338da950d7ef8f41f091def7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_68614b3338da950d7ef8f41f091def7c.jpg not downloaded yet
2026-03-30 09:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW67312> (referer: https://www.auto1.com/v1/car-details-view/PW67312/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:15 [auto1.it] INFO: Found listing with ID: CF41480
2026-03-30 09:06:15 [auto1.it] INFO: Found listing with ID: MR16221
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR16221%27 HTTP/1.1" 200 None
2026-03-30 09:06:15 [auto1.it] INFO: Scrape type for MR16221: 2
2026-03-30 09:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24950bd3-e936-5be9-8681-b00ce47756c3 with identifier: MR16221
2026-03-30 09:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24950bd3-e936-5be9-8681-b00ce47756c3 with scrape type 2
2026-03-30 09:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24950bd3-e936-5be9-8681-b00ce47756c3 with scrape type 2
2026-03-30 09:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 24950bd3-e936-5be9-8681-b00ce47756c3, identifier: MR16221
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_9f3a591a9c3e2a80fb8c3cb6571e8c24.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_9f3a591a9c3e2a80fb8c3cb6571e8c24.jpg not downloaded yet
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2744d10>
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_76481e8b4f64cb3742ad6f1a45334233.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_76481e8b4f64cb3742ad6f1a45334233.jpg saved to cache
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aed58a16-af46-53f7-b4dc-119a5bc2b50d
2026-03-30 09:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 24950bd3-e936-5be9-8681-b00ce47756c3 with identifier: MR16221
2026-03-30 09:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 24950bd3-e936-5be9-8681-b00ce47756c3 with identifier: MR16221
2026-03-30 09:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 24950bd3-e936-5be9-8681-b00ce47756c3 with identifier: MR16221 to the API
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:04:32Z',
 'fuel_type': 'diesel',
 'id': '24950bd3-e936-5be9-8681-b00ce47756c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR16221',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 159543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 CDTI DPF Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2018}
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR16221%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [auto1.it] INFO: Saving data for MR16221: {'auction_closing_time': 1774969472.0, 'created_time': 1773137829.799785, 'last_price_update_time': 1774861576.890869}
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR16221') HTTP/1.1" 204 0
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_0398caacea2e7b0de8b92f874fa98963.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:16 [auto1.it] INFO: Found listing with ID: MZ19465
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ19465%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [auto1.it] INFO: Scrape type for MZ19465: 1
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_114e2adbbc48926ad7345d9bb63d2147.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE75759> (referer: https://www.auto1.com/v1/car-details-view/ZE75759/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b1372ac-a032-5746-aad2-74d6fa5c0be9 with identifier: PW67312
2026-03-30 09:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9 with scrape type 1
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_3ca64f953c2488bb6fa4632e438e4723.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_3ca64f953c2488bb6fa4632e438e4723.jpg not downloaded yet
2026-03-30 09:06:16 [auto1.it] INFO: Found listing with ID: KL21440
2026-03-30 09:06:16 [auto1.it] INFO: Found listing with ID: XJ15185
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ15185%27 HTTP/1.1" 200 None
2026-03-30 09:06:16 [auto1.it] INFO: Scrape type for XJ15185: 1
2026-03-30 09:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR86104> (referer: https://www.auto1.com/v1/car-details-view/ZR86104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR95165> (referer: https://www.auto1.com/v1/car-details-view/XR95165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC63187> (referer: https://www.auto1.com/v1/car-details-view/RC63187/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA76603> (referer: https://www.auto1.com/v1/car-details-view/KA76603/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL77686/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_34cb8913a61a9670030e40054065eb2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_34cb8913a61a9670030e40054065eb2f.jpg not downloaded yet
2026-03-30 09:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:17 [auto1.it] INFO: Found listing with ID: FW53113
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW53113%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [auto1.it] INFO: Scrape type for FW53113: 1
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_d7f255bfe3edc5632259522ff948ba8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_d7f255bfe3edc5632259522ff948ba8b.jpg not downloaded yet
2026-03-30 09:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_68614b3338da950d7ef8f41f091def7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:17 [auto1.it] INFO: Found listing with ID: AX14141
2026-03-30 09:06:17 [auto1.it] INFO: Found listing with ID: NB05481
2026-03-30 09:06:17 [auto1.it] INFO: Found listing with ID: CW23076
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW23076%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [auto1.it] INFO: Scrape type for CW23076: 1
2026-03-30 09:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13f2750>
2026-03-30 09:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_0398caacea2e7b0de8b92f874fa98963.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_0398caacea2e7b0de8b92f874fa98963.jpg saved to cache
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aed58a16-af46-53f7-b4dc-119a5bc2b50d
2026-03-30 09:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee255c610>
2026-03-30 09:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_114e2adbbc48926ad7345d9bb63d2147.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_114e2adbbc48926ad7345d9bb63d2147.jpg saved to cache
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aed58a16-af46-53f7-b4dc-119a5bc2b50d
2026-03-30 09:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7e8881c-446f-55c7-9db9-0c00d8eb8945 with identifier: ZE75759
2026-03-30 09:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7e8881c-446f-55c7-9db9-0c00d8eb8945 with scrape type 1
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7e8881c-446f-55c7-9db9-0c00d8eb8945
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F1d%252F9e1d1c3cc097dcdfc57792f77930130d%252Fpa%252FZE75759_88d9546716dd8661a5486b29afc3674b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_88d9546716dd8661a5486b29afc3674b.jpg already downloaded
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F1d%252F9e1d1c3cc097dcdfc57792f77930130d%252Fpa%252FZE75759_74082b94b60df662f6269d8c5b91f16d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_74082b94b60df662f6269d8c5b91f16d.jpg already downloaded
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F1d%252F9e1d1c3cc097dcdfc57792f77930130d%252Fpa%252FZE75759_dc2c99d5709f054aeb0d060041d41b94.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_dc2c99d5709f054aeb0d060041d41b94.jpg already downloaded
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F1d%252F9e1d1c3cc097dcdfc57792f77930130d%252Fpa%252FZE75759_b1b17b927978222541b1b80f34baf5eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_b1b17b927978222541b1b80f34baf5eb.jpg already downloaded
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F1d%252F9e1d1c3cc097dcdfc57792f77930130d%252Fpa%252FZE75759_f41ee6b176e1fb911cb1c9748dc07e3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_f41ee6b176e1fb911cb1c9748dc07e3f.jpg already downloaded
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F1d%252F9e1d1c3cc097dcdfc57792f77930130d%252Fpa%252FZE75759_cd187fe61ab66684b313d5d556308190.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_cd187fe61ab66684b313d5d556308190.jpg already downloaded
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F1d%252F9e1d1c3cc097dcdfc57792f77930130d%252Fpa%252FZE75759_b8b5894e1bf432b40051b23c50d12b07.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_b8b5894e1bf432b40051b23c50d12b07.jpg already downloaded
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F1d%252F9e1d1c3cc097dcdfc57792f77930130d%252Fpa%252FZE75759_55264a8f2653cd4fe34b5f8f888d7c89.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_55264a8f2653cd4fe34b5f8f888d7c89.jpg already downloaded
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F1d%252F9e1d1c3cc097dcdfc57792f77930130d%252Fpa%252FZE75759_6bb658354946697b2c661574bcf9872c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_6bb658354946697b2c661574bcf9872c.jpg already downloaded
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F1d%252F9e1d1c3cc097dcdfc57792f77930130d%252Fpa%252FZE75759_a4b8b1111c959f29b4fc8186e96708ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_a4b8b1111c959f29b4fc8186e96708ed.jpg already downloaded
2026-03-30 09:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c7e8881c-446f-55c7-9db9-0c00d8eb8945, identifier: ZE75759
2026-03-30 09:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9277cfad-ac07-54b1-8b5d-936d2c021c9c with identifier: ZR86104
2026-03-30 09:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c with scrape type 1
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_cd5a8b106e7a79cf7f20c1391d540799.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_cd5a8b106e7a79cf7f20c1391d540799.jpg not downloaded yet
2026-03-30 09:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d628d6c2-6eee-5ba7-bf02-527049a3c587 with identifier: XR95165
2026-03-30 09:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d628d6c2-6eee-5ba7-bf02-527049a3c587 with scrape type 1
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d628d6c2-6eee-5ba7-bf02-527049a3c587
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_a5fa78831a6045c8f6559331550c5e0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_a5fa78831a6045c8f6559331550c5e0b.jpg not downloaded yet
2026-03-30 09:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37a65657-0884-595c-9188-1906d489adba with identifier: RC63187
2026-03-30 09:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37a65657-0884-595c-9188-1906d489adba with scrape type 1
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37a65657-0884-595c-9188-1906d489adba
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_fe265bbe6defd8c80e39643f328600bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_fe265bbe6defd8c80e39643f328600bb.jpg not downloaded yet
2026-03-30 09:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c82e4378-9bce-5734-95c1-38ad22eef594 with identifier: KA76603
2026-03-30 09:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82e4378-9bce-5734-95c1-38ad22eef594 with scrape type 1
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c82e4378-9bce-5734-95c1-38ad22eef594
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_6181549919837afe1dd4b6a6313170bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_6181549919837afe1dd4b6a6313170bf.jpg not downloaded yet
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_10396fad1e0834305dcc39b7f6bf358a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_10396fad1e0834305dcc39b7f6bf358a.jpg not downloaded yet
2026-03-30 09:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c7e8881c-446f-55c7-9db9-0c00d8eb8945 with identifier: ZE75759
2026-03-30 09:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c7e8881c-446f-55c7-9db9-0c00d8eb8945 with identifier: ZE75759
2026-03-30 09:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c7e8881c-446f-55c7-9db9-0c00d8eb8945 with identifier: ZE75759 to the API
2026-03-30 09:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZE75759>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:03:49Z',
 'fuel_type': 'diesel',
 'id': 'c7e8881c-446f-55c7-9db9-0c00d8eb8945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE75759',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 171090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_88d9546716dd8661a5486b29afc3674b.jpg',
                'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_74082b94b60df662f6269d8c5b91f16d.jpg',
                'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_dc2c99d5709f054aeb0d060041d41b94.jpg',
                'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_b1b17b927978222541b1b80f34baf5eb.jpg',
                'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_f41ee6b176e1fb911cb1c9748dc07e3f.jpg',
                'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_cd187fe61ab66684b313d5d556308190.jpg',
                'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_b8b5894e1bf432b40051b23c50d12b07.jpg',
                'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_55264a8f2653cd4fe34b5f8f888d7c89.jpg',
                'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_6bb658354946697b2c661574bcf9872c.jpg',
                'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_a4b8b1111c959f29b4fc8186e96708ed.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7e8881c-446f-55c7-9db9-0c00d8eb8945/c7e8881c-446f-55c7-9db9-0c00d8eb8945_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_88d9546716dd8661a5486b29afc3674b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7e8881c-446f-55c7-9db9-0c00d8eb8945/c7e8881c-446f-55c7-9db9-0c00d8eb8945_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_74082b94b60df662f6269d8c5b91f16d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7e8881c-446f-55c7-9db9-0c00d8eb8945/c7e8881c-446f-55c7-9db9-0c00d8eb8945_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_dc2c99d5709f054aeb0d060041d41b94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7e8881c-446f-55c7-9db9-0c00d8eb8945/c7e8881c-446f-55c7-9db9-0c00d8eb8945_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_b1b17b927978222541b1b80f34baf5eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7e8881c-446f-55c7-9db9-0c00d8eb8945/c7e8881c-446f-55c7-9db9-0c00d8eb8945_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_f41ee6b176e1fb911cb1c9748dc07e3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7e8881c-446f-55c7-9db9-0c00d8eb8945/c7e8881c-446f-55c7-9db9-0c00d8eb8945_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_cd187fe61ab66684b313d5d556308190.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7e8881c-446f-55c7-9db9-0c00d8eb8945/c7e8881c-446f-55c7-9db9-0c00d8eb8945_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_b8b5894e1bf432b40051b23c50d12b07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7e8881c-446f-55c7-9db9-0c00d8eb8945/c7e8881c-446f-55c7-9db9-0c00d8eb8945_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_55264a8f2653cd4fe34b5f8f888d7c89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7e8881c-446f-55c7-9db9-0c00d8eb8945/c7e8881c-446f-55c7-9db9-0c00d8eb8945_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_6bb658354946697b2c661574bcf9872c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7e8881c-446f-55c7-9db9-0c00d8eb8945/c7e8881c-446f-55c7-9db9-0c00d8eb8945_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/1d/9e1d1c3cc097dcdfc57792f77930130d/pa/ZE75759_a4b8b1111c959f29b4fc8186e96708ed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2013}
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE75759%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [auto1.it] INFO: Saving data for ZE75759: {'created_time': 1774861578.422131, 'last_price_update_time': 1774861578.422144, 'auction_closing_time': 1774969429.0}
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZE75759') HTTP/1.1" 204 0
2026-03-30 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_3ca64f953c2488bb6fa4632e438e4723.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:18 [auto1.it] INFO: Found listing with ID: PP58760
2026-03-30 09:06:18 [auto1.it] INFO: Found listing with ID: DW47560
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW47560%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [auto1.it] INFO: Scrape type for DW47560: 1
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_198e8ee7678617571ff6488586ed0083.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_198e8ee7678617571ff6488586ed0083.jpg not downloaded yet
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_13344dc1dfdca722fe792eb99254e82e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_13344dc1dfdca722fe792eb99254e82e.jpg not downloaded yet
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_c44f15318cfc8c27de48df5a4beeef3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_c44f15318cfc8c27de48df5a4beeef3d.jpg not downloaded yet
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_35e9a16392155da5be5848b9ef01b65d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_35e9a16392155da5be5848b9ef01b65d.jpg not downloaded yet
2026-03-30 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_9f3a591a9c3e2a80fb8c3cb6571e8c24.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_3994812cc78edca177ea8c637006da6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_5e9aad1dce9a29249d6e4e11f1d11ac6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_a638bcea24fec8aa5228d1e29905dc3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_a638bcea24fec8aa5228d1e29905dc3f.jpg not downloaded yet
2026-03-30 09:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG78231> (referer: https://www.auto1.com/v1/car-details-view/UG78231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:18 [auto1.it] INFO: Found listing with ID: UB63640
2026-03-30 09:06:18 [auto1.it] INFO: Found listing with ID: SY30215
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY30215%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [auto1.it] INFO: Scrape type for SY30215: 2
2026-03-30 09:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12831f7b-2139-52cf-813c-11bc215828ed with identifier: SY30215
2026-03-30 09:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12831f7b-2139-52cf-813c-11bc215828ed with scrape type 2
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12831f7b-2139-52cf-813c-11bc215828ed with scrape type 2
2026-03-30 09:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12831f7b-2139-52cf-813c-11bc215828ed, identifier: SY30215
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_7871f13b9fb9a64c706f9b3968645e3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_7871f13b9fb9a64c706f9b3968645e3e.jpg not downloaded yet
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_ae043554dcfb42cf39912896caa45d0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_ae043554dcfb42cf39912896caa45d0b.jpg not downloaded yet
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_312f2cf381d261b95b5fe62023249dd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_312f2cf381d261b95b5fe62023249dd9.jpg not downloaded yet
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_f6f38ed2d2c4d860cc98f220acbca7b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_f6f38ed2d2c4d860cc98f220acbca7b9.jpg not downloaded yet
2026-03-30 09:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee477fa10>
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_68614b3338da950d7ef8f41f091def7c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_68614b3338da950d7ef8f41f091def7c.jpg saved to cache
2026-03-30 09:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aed58a16-af46-53f7-b4dc-119a5bc2b50d
2026-03-30 09:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12831f7b-2139-52cf-813c-11bc215828ed with identifier: SY30215
2026-03-30 09:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12831f7b-2139-52cf-813c-11bc215828ed with identifier: SY30215
2026-03-30 09:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 12831f7b-2139-52cf-813c-11bc215828ed with identifier: SY30215 to the API
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:21:00Z',
 'fuel_type': 'petrol',
 'id': '12831f7b-2139-52cf-813c-11bc215828ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY30215',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 95127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-23',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 XSI',
 'transmission': 'automatic',
 'trim': 'XSI',
 'year': 2008}
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY30215%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [auto1.it] INFO: Saving data for SY30215: {'auction_closing_time': 1774970460.0, 'created_time': 1773130160.588276, 'last_price_update_time': 1774861580.048371}
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SY30215') HTTP/1.1" 204 0
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_0aa6b1563af19c957f24f2722884374b.png%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_0aa6b1563af19c957f24f2722884374b.png not downloaded yet
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1397c50>
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_3ca64f953c2488bb6fa4632e438e4723.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_3ca64f953c2488bb6fa4632e438e4723.jpg saved to cache
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9
2026-03-30 09:06:20 [auto1.it] INFO: Found listing with ID: GM45638
2026-03-30 09:06:20 [auto1.it] INFO: Found listing with ID: LA34369
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA34369%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [auto1.it] INFO: Scrape type for LA34369: 1
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_7d6cc0d959c5263fdf946776459d3f1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_7d6cc0d959c5263fdf946776459d3f1e.jpg not downloaded yet
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_f09e3f2570fb525b5429d41c77428a0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_f09e3f2570fb525b5429d41c77428a0e.jpg not downloaded yet
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_ae287d3748b06c141e08e6c03877b466.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_ae287d3748b06c141e08e6c03877b466.jpg not downloaded yet
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_054d262c359b601d2ca102ba63bfe7f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_054d262c359b601d2ca102ba63bfe7f0.jpg not downloaded yet
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_87246c85c74288931d48d1f6f37acf68.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_87246c85c74288931d48d1f6f37acf68.jpg not downloaded yet
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13d4910>
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_9f3a591a9c3e2a80fb8c3cb6571e8c24.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_9f3a591a9c3e2a80fb8c3cb6571e8c24.jpg saved to cache
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aed58a16-af46-53f7-b4dc-119a5bc2b50d
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1433e50>
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_3994812cc78edca177ea8c637006da6d.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_3994812cc78edca177ea8c637006da6d.jpg saved to cache
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aed58a16-af46-53f7-b4dc-119a5bc2b50d
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1295090>
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_5e9aad1dce9a29249d6e4e11f1d11ac6.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_5e9aad1dce9a29249d6e4e11f1d11ac6.jpg saved to cache
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aed58a16-af46-53f7-b4dc-119a5bc2b50d
2026-03-30 09:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead25b04-121c-52db-a702-61c66fe28de1 with identifier: UG78231
2026-03-30 09:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead25b04-121c-52db-a702-61c66fe28de1 with scrape type 1
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ead25b04-121c-52db-a702-61c66fe28de1
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbf%252F5bbf17f65b13fcfd2047da4ae76b841d%252Fpa%252FUG78231_397d64e330342efe5c364deb83959cf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_397d64e330342efe5c364deb83959cf4.jpg already downloaded
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbf%252F5bbf17f65b13fcfd2047da4ae76b841d%252Fpa%252FUG78231_8eedbc010dba1554313f31110f2a5d9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_8eedbc010dba1554313f31110f2a5d9d.jpg already downloaded
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbf%252F5bbf17f65b13fcfd2047da4ae76b841d%252Fpa%252FUG78231_c9269e2ca4eae7c5b27731e60717ca7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_c9269e2ca4eae7c5b27731e60717ca7e.jpg already downloaded
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbf%252F5bbf17f65b13fcfd2047da4ae76b841d%252Fpa%252FUG78231_ce72c430f19e0c17c6def1ae90492a1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_ce72c430f19e0c17c6def1ae90492a1d.jpg already downloaded
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbf%252F5bbf17f65b13fcfd2047da4ae76b841d%252Fpa%252FUG78231_821152c764a8896a35daaac779861883.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_821152c764a8896a35daaac779861883.jpg already downloaded
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbf%252F5bbf17f65b13fcfd2047da4ae76b841d%252Fpa%252FUG78231_32ae293573ab077a9406673ab1ed65c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_32ae293573ab077a9406673ab1ed65c1.jpg already downloaded
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbf%252F5bbf17f65b13fcfd2047da4ae76b841d%252Fpa%252FUG78231_d53e967ebb68dcdce85a44db62354520.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_d53e967ebb68dcdce85a44db62354520.jpg already downloaded
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbf%252F5bbf17f65b13fcfd2047da4ae76b841d%252Fpa%252FUG78231_24a0044302921b1251510392c3e3b9bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_24a0044302921b1251510392c3e3b9bd.jpg already downloaded
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbf%252F5bbf17f65b13fcfd2047da4ae76b841d%252Fpa%252FUG78231_0579b32751d3cb67410be3e7d56dc9df.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_0579b32751d3cb67410be3e7d56dc9df.jpg already downloaded
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fbf%252F5bbf17f65b13fcfd2047da4ae76b841d%252Fpa%252FUG78231_c2f25c5b292fd2033fe55d12a4bc3362.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_c2f25c5b292fd2033fe55d12a4bc3362.jpg already downloaded
2026-03-30 09:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ead25b04-121c-52db-a702-61c66fe28de1, identifier: UG78231
2026-03-30 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_35e9a16392155da5be5848b9ef01b65d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_10396fad1e0834305dcc39b7f6bf358a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_6181549919837afe1dd4b6a6313170bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:20 [auto1.it] INFO: Found listing with ID: KB21733
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB21733%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [auto1.it] INFO: Scrape type for KB21733: 1
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_62027ba722c45ff52168eb7fe918b297.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_62027ba722c45ff52168eb7fe918b297.jpg not downloaded yet
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_499f8a3246a4e743b640aacbedb0b1a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_499f8a3246a4e743b640aacbedb0b1a2.jpg not downloaded yet
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_b36801e5b95d9de73ced57c3f5d284eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_b36801e5b95d9de73ced57c3f5d284eb.jpg not downloaded yet
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_373f1d1fcf0d10eb7cb68a4c1a21598c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_373f1d1fcf0d10eb7cb68a4c1a21598c.jpg not downloaded yet
2026-03-30 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ19465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW52092/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ64307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL20589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ead25b04-121c-52db-a702-61c66fe28de1 with identifier: UG78231
2026-03-30 09:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ead25b04-121c-52db-a702-61c66fe28de1 with identifier: UG78231
2026-03-30 09:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ead25b04-121c-52db-a702-61c66fe28de1 with identifier: UG78231 to the API
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UG78231>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:34:41Z',
 'fuel_type': 'diesel',
 'id': 'ead25b04-121c-52db-a702-61c66fe28de1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG78231',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 149495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_397d64e330342efe5c364deb83959cf4.jpg',
                'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_8eedbc010dba1554313f31110f2a5d9d.jpg',
                'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_c9269e2ca4eae7c5b27731e60717ca7e.jpg',
                'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_ce72c430f19e0c17c6def1ae90492a1d.jpg',
                'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_821152c764a8896a35daaac779861883.jpg',
                'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_32ae293573ab077a9406673ab1ed65c1.jpg',
                'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_d53e967ebb68dcdce85a44db62354520.jpg',
                'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_24a0044302921b1251510392c3e3b9bd.jpg',
                'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_0579b32751d3cb67410be3e7d56dc9df.jpg',
                'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_c2f25c5b292fd2033fe55d12a4bc3362.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead25b04-121c-52db-a702-61c66fe28de1/ead25b04-121c-52db-a702-61c66fe28de1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_397d64e330342efe5c364deb83959cf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead25b04-121c-52db-a702-61c66fe28de1/ead25b04-121c-52db-a702-61c66fe28de1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_8eedbc010dba1554313f31110f2a5d9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead25b04-121c-52db-a702-61c66fe28de1/ead25b04-121c-52db-a702-61c66fe28de1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_c9269e2ca4eae7c5b27731e60717ca7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead25b04-121c-52db-a702-61c66fe28de1/ead25b04-121c-52db-a702-61c66fe28de1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_ce72c430f19e0c17c6def1ae90492a1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead25b04-121c-52db-a702-61c66fe28de1/ead25b04-121c-52db-a702-61c66fe28de1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_821152c764a8896a35daaac779861883.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead25b04-121c-52db-a702-61c66fe28de1/ead25b04-121c-52db-a702-61c66fe28de1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_32ae293573ab077a9406673ab1ed65c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead25b04-121c-52db-a702-61c66fe28de1/ead25b04-121c-52db-a702-61c66fe28de1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_d53e967ebb68dcdce85a44db62354520.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead25b04-121c-52db-a702-61c66fe28de1/ead25b04-121c-52db-a702-61c66fe28de1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_24a0044302921b1251510392c3e3b9bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead25b04-121c-52db-a702-61c66fe28de1/ead25b04-121c-52db-a702-61c66fe28de1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_0579b32751d3cb67410be3e7d56dc9df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ead25b04-121c-52db-a702-61c66fe28de1/ead25b04-121c-52db-a702-61c66fe28de1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/bf/5bbf17f65b13fcfd2047da4ae76b841d/pa/UG78231_c2f25c5b292fd2033fe55d12a4bc3362.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T 4Matic AMG Sport',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Sport',
 'year': 2016}
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UG78231%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [auto1.it] INFO: Saving data for UG78231: {'created_time': 1774861581.362379, 'last_price_update_time': 1774861581.362388, 'auction_closing_time': 1774971281.0}
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UG78231') HTTP/1.1" 204 0
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_887eecd57fa29ed777fd76b8e794d074.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_887eecd57fa29ed777fd76b8e794d074.jpg not downloaded yet
2026-03-30 09:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU77686/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: ZZ37544
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: HP37847
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: FK67266
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK67266%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [auto1.it] INFO: Scrape type for FK67266: 1
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_0738a7321546a844e90a22f9434ba282.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_0738a7321546a844e90a22f9434ba282.jpg not downloaded yet
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_26a3cbb93f86c394a8e7862045402e05.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_26a3cbb93f86c394a8e7862045402e05.jpg not downloaded yet
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_8417647a8ad30977ff787c2d3c039cbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_8417647a8ad30977ff787c2d3c039cbf.jpg not downloaded yet
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_baca92335db858ef1c487bea77104725.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_baca92335db858ef1c487bea77104725.jpg not downloaded yet
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_6d750b01b6e62613716be1e475a06a2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_6d750b01b6e62613716be1e475a06a2a.jpg not downloaded yet
2026-03-30 09:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA30561> (referer: https://www.auto1.com/v1/car-details-view/DA30561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: AH42786
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: RV38017
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV38017%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [auto1.it] INFO: Scrape type for RV38017: 1
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_74c469f522f7a5d4ad5e5eb13c33d0a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_74c469f522f7a5d4ad5e5eb13c33d0a1.jpg not downloaded yet
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_4e4acb1b71726a7aa5b99a566feca3d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_4e4acb1b71726a7aa5b99a566feca3d9.jpg not downloaded yet
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_7ffc7f984783bf2786491b99ba32fe87.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_7ffc7f984783bf2786491b99ba32fe87.jpg not downloaded yet
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_62b09e8fd4518d688b575458d35ab473.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_62b09e8fd4518d688b575458d35ab473.jpg not downloaded yet
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1375dd0>
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_35e9a16392155da5be5848b9ef01b65d.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_35e9a16392155da5be5848b9ef01b65d.jpg saved to cache
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c82e4378-9bce-5734-95c1-38ad22eef594
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13ca4d0>
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_10396fad1e0834305dcc39b7f6bf358a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_10396fad1e0834305dcc39b7f6bf358a.jpg saved to cache
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1276a50>
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_6181549919837afe1dd4b6a6313170bf.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_6181549919837afe1dd4b6a6313170bf.jpg saved to cache
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c82e4378-9bce-5734-95c1-38ad22eef594
2026-03-30 09:06:21 [auto1.it] INFO: Channel: 24h | Page: 5 | totalHits: 3305 | hits on page: 40
2026-03-30 09:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_f09e3f2570fb525b5429d41c77428a0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_db5b72acf7e06223fc320c7c39bf34cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_db5b72acf7e06223fc320c7c39bf34cc.jpg not downloaded yet
2026-03-30 09:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_87246c85c74288931d48d1f6f37acf68.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: JK64224
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: CL10517
2026-03-30 09:06:21 [auto1.it] INFO: Found listing with ID: BK72599
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK72599%27 HTTP/1.1" 200 None
2026-03-30 09:06:21 [auto1.it] INFO: Scrape type for BK72599: 2
2026-03-30 09:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with identifier: BK72599
2026-03-30 09:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with scrape type 2
2026-03-30 09:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with scrape type 2
2026-03-30 09:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822, identifier: BK72599
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_031015c6a962908fc57d98f1eb916920.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_031015c6a962908fc57d98f1eb916920.jpg not downloaded yet
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_97f17902b5c8f568b5755580e587fcb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_97f17902b5c8f568b5755580e587fcb4.jpg not downloaded yet
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_b5f9c7994aeaa1f00ed4c548278bfc0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_b5f9c7994aeaa1f00ed4c548278bfc0d.jpg not downloaded yet
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_76486e9244de2444eb04011170af6fe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_76486e9244de2444eb04011170af6fe0.jpg not downloaded yet
2026-03-30 09:06:22 [auto1.it] INFO: Found listing with ID: BK72599
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK72599%27 HTTP/1.1" 200 None
2026-03-30 09:06:22 [auto1.it] INFO: Scrape type for BK72599: 2
2026-03-30 09:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with scrape type 2
2026-03-30 09:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with scrape type 2
2026-03-30 09:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822, identifier: BK72599
2026-03-30 09:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_ae287d3748b06c141e08e6c03877b466.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_7d6cc0d959c5263fdf946776459d3f1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with identifier: BK72599
2026-03-30 09:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with identifier: BK72599
2026-03-30 09:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with identifier: BK72599 to the API
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:30:16Z',
 'fuel_type': 'diesel',
 'id': '4e8eb3e1-82dc-58d2-b9b6-e49299cd6822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK72599',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 199764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-08',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Wave',
 'transmission': 'manual',
 'trim': 'Wave',
 'year': 2014}
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK72599%27 HTTP/1.1" 200 None
2026-03-30 09:06:22 [auto1.it] INFO: Saving data for BK72599: {'auction_closing_time': 1774971016.0, 'created_time': 1774267560.063356, 'last_price_update_time': 1774861582.652951}
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BK72599') HTTP/1.1" 204 0
2026-03-30 09:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with identifier: BK72599
2026-03-30 09:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with identifier: BK72599
2026-03-30 09:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with identifier: BK72599 to the API
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:30:16Z',
 'fuel_type': 'diesel',
 'id': '4e8eb3e1-82dc-58d2-b9b6-e49299cd6822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK72599',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 199764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-08',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Wave',
 'transmission': 'manual',
 'trim': 'Wave',
 'year': 2014}
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK72599%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [auto1.it] INFO: Saving data for BK72599: {'auction_closing_time': 1774971016.0, 'created_time': 1774267560.063356, 'last_price_update_time': 1774861583.076026}
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BK72599') HTTP/1.1" 204 0
2026-03-30 09:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34df70c4-3a7e-5022-913d-5811e4275b13 with identifier: DA30561
2026-03-30 09:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34df70c4-3a7e-5022-913d-5811e4275b13 with scrape type 1
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34df70c4-3a7e-5022-913d-5811e4275b13
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_1cadf70d5b516a55008d836f2101afc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_1cadf70d5b516a55008d836f2101afc4.jpg not downloaded yet
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_8af26d2ccb7dcc76d63702ac6c2a88c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_8af26d2ccb7dcc76d63702ac6c2a88c7.jpg not downloaded yet
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_d6bff64a741ad84227ff3fd4ee4a0308.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_d6bff64a741ad84227ff3fd4ee4a0308.jpg not downloaded yet
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_d1c77c69765ded013b71568629deec8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_d1c77c69765ded013b71568629deec8c.jpg not downloaded yet
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_c3fff2a881913fdeb00f40acd7a721c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_c3fff2a881913fdeb00f40acd7a721c4.jpg not downloaded yet
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: NP53767
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: PZ28359
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: VA85498
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: CW61411
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: VN45721
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN45721%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [auto1.it] INFO: Scrape type for VN45721: 1
2026-03-30 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_907f125fcce80a18eb5d4acdcba12d5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_3a7794de5199ead1f3d3689c01910c30.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_c9d7b8b9108968942ad881758d902e85.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_c9d7b8b9108968942ad881758d902e85.jpg not downloaded yet
2026-03-30 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC41125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1097a90>
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_f09e3f2570fb525b5429d41c77428a0e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_f09e3f2570fb525b5429d41c77428a0e.jpg saved to cache
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d628d6c2-6eee-5ba7-bf02-527049a3c587
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26ebd10>
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_87246c85c74288931d48d1f6f37acf68.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_87246c85c74288931d48d1f6f37acf68.jpg saved to cache
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_56a025e28916b6739155a8554e94ffda.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_56a025e28916b6739155a8554e94ffda.jpg not downloaded yet
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_cbda28584c1f59e8ae2393eb07aa7d85.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_cbda28584c1f59e8ae2393eb07aa7d85.jpg not downloaded yet
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_225e02c06b4de9b8586e4e51fa2bcea3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_225e02c06b4de9b8586e4e51fa2bcea3.jpg not downloaded yet
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_dbd4cc8bc06c0c826556b589e03dda6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_dbd4cc8bc06c0c826556b589e03dda6c.jpg not downloaded yet
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: FJ15819
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: RX35107
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX35107%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [auto1.it] INFO: Scrape type for RX35107: 1
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1292b10>
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_ae287d3748b06c141e08e6c03877b466.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_ae287d3748b06c141e08e6c03877b466.jpg saved to cache
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37a65657-0884-595c-9188-1906d489adba
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee283ed50>
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_7d6cc0d959c5263fdf946776459d3f1e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_7d6cc0d959c5263fdf946776459d3f1e.jpg saved to cache
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_38726bc17ac5541115d0d8df7c8099a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_38726bc17ac5541115d0d8df7c8099a9.jpg not downloaded yet
2026-03-30 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_373f1d1fcf0d10eb7cb68a4c1a21598c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_baca92335db858ef1c487bea77104725.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: LH23516
2026-03-30 09:06:23 [auto1.it] INFO: Found listing with ID: GZ60590
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ60590%27 HTTP/1.1" 200 None
2026-03-30 09:06:23 [auto1.it] INFO: Scrape type for GZ60590: 2
2026-03-30 09:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 580f8fae-b4cd-5e33-a889-186e103a1d48 with identifier: GZ60590
2026-03-30 09:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 580f8fae-b4cd-5e33-a889-186e103a1d48 with scrape type 2
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 580f8fae-b4cd-5e33-a889-186e103a1d48 with scrape type 2
2026-03-30 09:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 580f8fae-b4cd-5e33-a889-186e103a1d48, identifier: GZ60590
2026-03-30 09:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2507550>
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_907f125fcce80a18eb5d4acdcba12d5f.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_907f125fcce80a18eb5d4acdcba12d5f.jpg saved to cache
2026-03-30 09:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdab4158-2154-5b1a-9490-057db1962860
2026-03-30 09:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26d7010>
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_3a7794de5199ead1f3d3689c01910c30.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_3a7794de5199ead1f3d3689c01910c30.jpg saved to cache
2026-03-30 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdab4158-2154-5b1a-9490-057db1962860
2026-03-30 09:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_db5b72acf7e06223fc320c7c39bf34cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_6d750b01b6e62613716be1e475a06a2a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 580f8fae-b4cd-5e33-a889-186e103a1d48 with identifier: GZ60590
2026-03-30 09:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 580f8fae-b4cd-5e33-a889-186e103a1d48 with identifier: GZ60590
2026-03-30 09:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 580f8fae-b4cd-5e33-a889-186e103a1d48 with identifier: GZ60590 to the API
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:07:39Z',
 'fuel_type': 'diesel',
 'id': '580f8fae-b4cd-5e33-a889-186e103a1d48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ60590',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 76948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ60590%27 HTTP/1.1" 200 None
2026-03-30 09:06:24 [auto1.it] INFO: Saving data for GZ60590: {'auction_closing_time': 1774969659.0, 'created_time': 1770926456.072749, 'last_price_update_time': 1774861584.805807}
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ60590') HTTP/1.1" 204 0
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_48509a01df9c12bd1acb43f1600f03bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_48509a01df9c12bd1acb43f1600f03bc.jpg not downloaded yet
2026-03-30 09:06:24 [auto1.it] INFO: Found listing with ID: FD90362
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD90362%27 HTTP/1.1" 200 None
2026-03-30 09:06:24 [auto1.it] INFO: Scrape type for FD90362: 1
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_e30142390bf0f3c7fe0f3321b398f0d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_e30142390bf0f3c7fe0f3321b398f0d3.jpg not downloaded yet
2026-03-30 09:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA34369/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW53113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1109ad0>
2026-03-30 09:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_373f1d1fcf0d10eb7cb68a4c1a21598c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_373f1d1fcf0d10eb7cb68a4c1a21598c.jpg saved to cache
2026-03-30 09:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c82e4378-9bce-5734-95c1-38ad22eef594
2026-03-30 09:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11f4850>
2026-03-30 09:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_baca92335db858ef1c487bea77104725.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_baca92335db858ef1c487bea77104725.jpg saved to cache
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c82e4378-9bce-5734-95c1-38ad22eef594
2026-03-30 09:06:25 [auto1.it] INFO: Found listing with ID: YA01979
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA01979%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [auto1.it] INFO: Scrape type for YA01979: 1
2026-03-30 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL77686> (referer: https://www.auto1.com/v1/car-details-view/JL77686/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_f2148e359f36519b815fc48b835bde32.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_f2148e359f36519b815fc48b835bde32.jpg not downloaded yet
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1110fd0>
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_db5b72acf7e06223fc320c7c39bf34cc.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_db5b72acf7e06223fc320c7c39bf34cc.jpg saved to cache
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2571d10>
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_6d750b01b6e62613716be1e475a06a2a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_6d750b01b6e62613716be1e475a06a2a.jpg saved to cache
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9
2026-03-30 09:06:25 [auto1.it] INFO: Found listing with ID: EP59254
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP59254%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [auto1.it] INFO: Scrape type for EP59254: 1
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_3bcc53cc948312647dd5932119cb494e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_3bcc53cc948312647dd5932119cb494e.jpg not downloaded yet
2026-03-30 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_48509a01df9c12bd1acb43f1600f03bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_38726bc17ac5541115d0d8df7c8099a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:25 [auto1.it] INFO: Found listing with ID: NR09565
2026-03-30 09:06:25 [auto1.it] INFO: Found listing with ID: HT52131
2026-03-30 09:06:25 [auto1.it] INFO: Found listing with ID: VU13250
2026-03-30 09:06:25 [auto1.it] INFO: Found listing with ID: CM15211
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM15211%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [auto1.it] INFO: Scrape type for CM15211: 2
2026-03-30 09:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebbd6b76-ef95-5985-8b7c-9cbc5586ea21 with identifier: CM15211
2026-03-30 09:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebbd6b76-ef95-5985-8b7c-9cbc5586ea21 with scrape type 2
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebbd6b76-ef95-5985-8b7c-9cbc5586ea21 with scrape type 2
2026-03-30 09:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ebbd6b76-ef95-5985-8b7c-9cbc5586ea21, identifier: CM15211
2026-03-30 09:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5887a42d-53a5-559d-a387-e5c6577c131c with identifier: JL77686
2026-03-30 09:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5887a42d-53a5-559d-a387-e5c6577c131c with scrape type 1
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5887a42d-53a5-559d-a387-e5c6577c131c
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_3de27fce1314ed2e375bb15c095ce453.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3de27fce1314ed2e375bb15c095ce453.jpg not downloaded yet
2026-03-30 09:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_0aa6b1563af19c957f24f2722884374b.png> (referer: https://www.auto1.com/)
2026-03-30 09:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ebbd6b76-ef95-5985-8b7c-9cbc5586ea21 with identifier: CM15211
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 09:06:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ebbd6b76-ef95-5985-8b7c-9cbc5586ea21 with identifier: CM15211
2026-03-30 09:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ebbd6b76-ef95-5985-8b7c-9cbc5586ea21 with identifier: CM15211 to the API
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:06:57Z',
 'fuel_type': 'electro',
 'id': 'ebbd6b76-ef95-5985-8b7c-9cbc5586ea21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM15211',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 34,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-29',
 'seller_name': None,
 'title': 'Peugeot Expert electric drive 100 kW',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM15211%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [auto1.it] INFO: Saving data for CM15211: {'auction_closing_time': 1774969617.0, 'created_time': 1774041013.125039, 'last_price_update_time': 1774861586.154631}
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CM15211') HTTP/1.1" 204 0
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_00762108c415d1521f01d908a1cf0351.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_00762108c415d1521f01d908a1cf0351.jpg not downloaded yet
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: ZM54486
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: SV41912
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: AV22109
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: JA46971
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA46971%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [auto1.it] INFO: Scrape type for JA46971: 1
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_3e5f91fc4482653853873ebcf3c93353.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3e5f91fc4482653853873ebcf3c93353.jpg not downloaded yet
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_41bdecc48d1762d4f95b41e089731a60.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_41bdecc48d1762d4f95b41e089731a60.jpg not downloaded yet
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10917d0>
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_48509a01df9c12bd1acb43f1600f03bc.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_48509a01df9c12bd1acb43f1600f03bc.jpg saved to cache
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34df70c4-3a7e-5022-913d-5811e4275b13
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2571850>
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_38726bc17ac5541115d0d8df7c8099a9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_38726bc17ac5541115d0d8df7c8099a9.jpg saved to cache
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34df70c4-3a7e-5022-913d-5811e4275b13
2026-03-30 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_56a025e28916b6739155a8554e94ffda.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_cbda28584c1f59e8ae2393eb07aa7d85.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: CK19595
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: KY08376
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: JP33572
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP33572%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [auto1.it] INFO: Scrape type for JP33572: 1
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_5ed9ce3181b3a38616069abb031745c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_5ed9ce3181b3a38616069abb031745c9.jpg not downloaded yet
2026-03-30 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_e30142390bf0f3c7fe0f3321b398f0d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_b7925c4fbce39dfe2de02027219965fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_b7925c4fbce39dfe2de02027219965fe.jpg not downloaded yet
2026-03-30 09:06:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:26 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 09:06:26 [PIL.PngImagePlugin] DEBUG: STREAM b'iCCP' 41 354
2026-03-30 09:06:26 [PIL.PngImagePlugin] DEBUG: iCCP profile name b'icc'
2026-03-30 09:06:26 [PIL.PngImagePlugin] DEBUG: Compression method 0
2026-03-30 09:06:26 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 407 9
2026-03-30 09:06:26 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 428 939
2026-03-30 09:06:26 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1379 42
2026-03-30 09:06:26 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1433 24
2026-03-30 09:06:26 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1469 41
2026-03-30 09:06:26 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1522 37
2026-03-30 09:06:26 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 1571 8192
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26aa450>
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_5.png HTTP/1.1" 201 0
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_0aa6b1563af19c957f24f2722884374b.png') HTTP/1.1" 204 0
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_0aa6b1563af19c957f24f2722884374b.png saved to cache
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: WY43100
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY43100%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [auto1.it] INFO: Scrape type for WY43100: 1
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_3f1e0d3dc4bfb3e77558f79a6e7ef7fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3f1e0d3dc4bfb3e77558f79a6e7ef7fe.jpg not downloaded yet
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: FF00000
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: YH99570
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH99570%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [auto1.it] INFO: Scrape type for YH99570: 1
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_ea50b035a2230776dfb78ec18e55cdc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_ea50b035a2230776dfb78ec18e55cdc3.jpg not downloaded yet
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48d3690>
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_56a025e28916b6739155a8554e94ffda.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_56a025e28916b6739155a8554e94ffda.jpg saved to cache
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11933d0>
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_cbda28584c1f59e8ae2393eb07aa7d85.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_cbda28584c1f59e8ae2393eb07aa7d85.jpg saved to cache
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d628d6c2-6eee-5ba7-bf02-527049a3c587
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25c3550>
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_e30142390bf0f3c7fe0f3321b398f0d3.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_e30142390bf0f3c7fe0f3321b398f0d3.jpg saved to cache
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34df70c4-3a7e-5022-913d-5811e4275b13
2026-03-30 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_3bcc53cc948312647dd5932119cb494e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3e5f91fc4482653853873ebcf3c93353.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:26 [auto1.it] INFO: Found listing with ID: UF18413
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF18413%27 HTTP/1.1" 200 None
2026-03-30 09:06:26 [auto1.it] INFO: Scrape type for UF18413: 2
2026-03-30 09:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16436b8c-68b2-56ef-b4f4-e5f2ac8b350a with identifier: UF18413
2026-03-30 09:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16436b8c-68b2-56ef-b4f4-e5f2ac8b350a with scrape type 2
2026-03-30 09:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16436b8c-68b2-56ef-b4f4-e5f2ac8b350a with scrape type 2
2026-03-30 09:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 16436b8c-68b2-56ef-b4f4-e5f2ac8b350a, identifier: UF18413
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_2818012c624c02071ec39326f6e0c6e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_2818012c624c02071ec39326f6e0c6e0.jpg not downloaded yet
2026-03-30 09:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_41bdecc48d1762d4f95b41e089731a60.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 16436b8c-68b2-56ef-b4f4-e5f2ac8b350a with identifier: UF18413
2026-03-30 09:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 16436b8c-68b2-56ef-b4f4-e5f2ac8b350a with identifier: UF18413
2026-03-30 09:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 16436b8c-68b2-56ef-b4f4-e5f2ac8b350a with identifier: UF18413 to the API
2026-03-30 09:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:33:05Z',
 'fuel_type': 'diesel',
 'id': '16436b8c-68b2-56ef-b4f4-e5f2ac8b350a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF18413',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 96942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-11',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2017}
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF18413%27 HTTP/1.1" 200 None
2026-03-30 09:06:28 [auto1.it] INFO: Saving data for UF18413: {'auction_closing_time': 1774971185.0, 'created_time': 1773136053.312195, 'last_price_update_time': 1774861588.572475}
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UF18413') HTTP/1.1" 204 0
2026-03-30 09:06:28 [auto1.it] INFO: Found listing with ID: EY30987
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY30987%27 HTTP/1.1" 200 None
2026-03-30 09:06:28 [auto1.it] INFO: Scrape type for EY30987: 1
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_f5c9f13a37db7726df685173150dc0a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_f5c9f13a37db7726df685173150dc0a2.jpg not downloaded yet
2026-03-30 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_054d262c359b601d2ca102ba63bfe7f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC41125> (referer: https://www.auto1.com/v1/car-details-view/EC41125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD90362/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:28 [auto1.it] INFO: Found listing with ID: WF75031
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF75031%27 HTTP/1.1" 200 None
2026-03-30 09:06:28 [auto1.it] INFO: Scrape type for WF75031: 2
2026-03-30 09:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09d5f8a4-f0c0-5de4-9910-eae23ff24bab with identifier: WF75031
2026-03-30 09:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09d5f8a4-f0c0-5de4-9910-eae23ff24bab with scrape type 2
2026-03-30 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09d5f8a4-f0c0-5de4-9910-eae23ff24bab with scrape type 2
2026-03-30 09:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 09d5f8a4-f0c0-5de4-9910-eae23ff24bab, identifier: WF75031
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_dd02dd9e6ee7defc2d30a0c86b013f9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_dd02dd9e6ee7defc2d30a0c86b013f9d.jpg not downloaded yet
2026-03-30 09:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL20589> (referer: https://www.auto1.com/v1/car-details-view/AL20589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ64307> (referer: https://www.auto1.com/v1/car-details-view/KJ64307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA34369> (referer: https://www.auto1.com/v1/car-details-view/LA34369/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2537dd0>
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_3bcc53cc948312647dd5932119cb494e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_3bcc53cc948312647dd5932119cb494e.jpg saved to cache
2026-03-30 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34df70c4-3a7e-5022-913d-5811e4275b13
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee110a090>
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_3e5f91fc4482653853873ebcf3c93353.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3e5f91fc4482653853873ebcf3c93353.jpg saved to cache
2026-03-30 09:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5887a42d-53a5-559d-a387-e5c6577c131c
2026-03-30 09:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26aac10>
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_41bdecc48d1762d4f95b41e089731a60.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_41bdecc48d1762d4f95b41e089731a60.jpg saved to cache
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34df70c4-3a7e-5022-913d-5811e4275b13
2026-03-30 09:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 09d5f8a4-f0c0-5de4-9910-eae23ff24bab with identifier: WF75031
2026-03-30 09:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 09d5f8a4-f0c0-5de4-9910-eae23ff24bab with identifier: WF75031
2026-03-30 09:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 09d5f8a4-f0c0-5de4-9910-eae23ff24bab with identifier: WF75031 to the API
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:45:09Z',
 'fuel_type': 'diesel',
 'id': '09d5f8a4-f0c0-5de4-9910-eae23ff24bab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF75031',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 234961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Fiat Talento 1.6 TwinTurbo Diesel Ecojet L1H1 1,0t Basis',
 'transmission': 'manual',
 'trim': 'L1H1 1,0t Basis',
 'year': 2018}
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF75031%27 HTTP/1.1" 200 None
2026-03-30 09:06:29 [auto1.it] INFO: Saving data for WF75031: {'auction_closing_time': 1774971909.0, 'created_time': 1773134097.288241, 'last_price_update_time': 1774861589.511515}
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WF75031') HTTP/1.1" 204 0
2026-03-30 09:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_ea50b035a2230776dfb78ec18e55cdc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3f1e0d3dc4bfb3e77558f79a6e7ef7fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:29 [auto1.it] INFO: Found listing with ID: ST73163
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST73163%27 HTTP/1.1" 200 None
2026-03-30 09:06:29 [auto1.it] INFO: Scrape type for ST73163: 2
2026-03-30 09:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e1b16a1-bda0-53f0-9219-6ea1f08890d2 with identifier: ST73163
2026-03-30 09:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e1b16a1-bda0-53f0-9219-6ea1f08890d2 with scrape type 2
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e1b16a1-bda0-53f0-9219-6ea1f08890d2 with scrape type 2
2026-03-30 09:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e1b16a1-bda0-53f0-9219-6ea1f08890d2, identifier: ST73163
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_1476ae1a335cac1a2a90b2836ec4d217.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_1476ae1a335cac1a2a90b2836ec4d217.jpg not downloaded yet
2026-03-30 09:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e1b16a1-bda0-53f0-9219-6ea1f08890d2 with identifier: ST73163
2026-03-30 09:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e1b16a1-bda0-53f0-9219-6ea1f08890d2 with identifier: ST73163
2026-03-30 09:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e1b16a1-bda0-53f0-9219-6ea1f08890d2 with identifier: ST73163 to the API
2026-03-30 09:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:10:24Z',
 'fuel_type': 'diesel',
 'id': '2e1b16a1-bda0-53f0-9219-6ea1f08890d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST73163',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 112204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-28',
 'seller_name': None,
 'title': 'MINI Clubman Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST73163%27 HTTP/1.1" 200 None
2026-03-30 09:06:30 [auto1.it] INFO: Saving data for ST73163: {'auction_closing_time': 1774969824.0, 'created_time': 1772532239.7384, 'last_price_update_time': 1774861590.735668}
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ST73163') HTTP/1.1" 204 0
2026-03-30 09:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12ef2d0>
2026-03-30 09:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_054d262c359b601d2ca102ba63bfe7f0.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_054d262c359b601d2ca102ba63bfe7f0.jpg saved to cache
2026-03-30 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c82e4378-9bce-5734-95c1-38ad22eef594
2026-03-30 09:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e848de3e-3954-5fa3-af77-edb206202567 with identifier: EC41125
2026-03-30 09:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e848de3e-3954-5fa3-af77-edb206202567 with scrape type 1
2026-03-30 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e848de3e-3954-5fa3-af77-edb206202567
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F61%252F7e614605ef038547fe98ba9fabad693a%252Fpa%252FEC41125_14b4ca9fa61e1e58d25e4edcb3ea02ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_14b4ca9fa61e1e58d25e4edcb3ea02ce.jpg not downloaded yet
2026-03-30 09:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a700506d-ca0b-5ef4-8c6e-2119701c7ce1 with identifier: AL20589
2026-03-30 09:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1 with scrape type 1
2026-03-30 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_42538f2a4d773eb310573172ac0f989d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_42538f2a4d773eb310573172ac0f989d.jpg not downloaded yet
2026-03-30 09:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 138e4383-6c68-5c8e-8f52-78f6131b1bd8 with identifier: KJ64307
2026-03-30 09:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 138e4383-6c68-5c8e-8f52-78f6131b1bd8 with scrape type 1
2026-03-30 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 138e4383-6c68-5c8e-8f52-78f6131b1bd8
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6b%252F7c6b02728c82082118780992c8a21a68%252Fpa%252FKJ64307_15ec962100365c7f968705986e61ff15.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_15ec962100365c7f968705986e61ff15.jpg already downloaded
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6b%252F7c6b02728c82082118780992c8a21a68%252Fpa%252FKJ64307_cb16a5dc714562e510045e077af0d671.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_cb16a5dc714562e510045e077af0d671.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6b%252F7c6b02728c82082118780992c8a21a68%252Fpa%252FKJ64307_cc1aaed0669c0b8a7e8617019a0deb46.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_cc1aaed0669c0b8a7e8617019a0deb46.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6b%252F7c6b02728c82082118780992c8a21a68%252Fpa%252FKJ64307_f9306eb8b8638aab94a254ec0bde7799.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_f9306eb8b8638aab94a254ec0bde7799.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6b%252F7c6b02728c82082118780992c8a21a68%252Fpa%252FKJ64307_3da01d2c4483593aaa4bb523ea201910.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_3da01d2c4483593aaa4bb523ea201910.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6b%252F7c6b02728c82082118780992c8a21a68%252Fpa%252FKJ64307_c135a31bcda784bd150f29964a7bf448.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_c135a31bcda784bd150f29964a7bf448.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6b%252F7c6b02728c82082118780992c8a21a68%252Fpa%252FKJ64307_f836c78228b08c23300a5c7ac0559ce0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_f836c78228b08c23300a5c7ac0559ce0.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6b%252F7c6b02728c82082118780992c8a21a68%252Fpa%252FKJ64307_f27f1db58d72f37d02cd96cc7167559f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_f27f1db58d72f37d02cd96cc7167559f.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6b%252F7c6b02728c82082118780992c8a21a68%252Fpa%252FKJ64307_fcaca66d9c945cdbd41bd70bf8555865.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_fcaca66d9c945cdbd41bd70bf8555865.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F6b%252F7c6b02728c82082118780992c8a21a68%252Fpa%252FKJ64307_11fa31165e2b7d9a509fdd63a409e9fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_11fa31165e2b7d9a509fdd63a409e9fa.jpg already downloaded
2026-03-30 09:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 138e4383-6c68-5c8e-8f52-78f6131b1bd8, identifier: KJ64307
2026-03-30 09:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adc4095f-81b5-5549-89a2-b8cd71eb7542 with identifier: LA34369
2026-03-30 09:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adc4095f-81b5-5549-89a2-b8cd71eb7542 with scrape type 1
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item adc4095f-81b5-5549-89a2-b8cd71eb7542
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fd8%252F9cd85be278ad2375e7719f924567ae4e%252Fpa%252FLA34369_8082f96701737bb28f97bc5b13ac3d26.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_8082f96701737bb28f97bc5b13ac3d26.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fd8%252F9cd85be278ad2375e7719f924567ae4e%252Fpa%252FLA34369_4f6fe6394ed57bc2f71dd9d56fdc63b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_4f6fe6394ed57bc2f71dd9d56fdc63b5.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fd8%252F9cd85be278ad2375e7719f924567ae4e%252Fpa%252FLA34369_04ea83a062c64d7068af56b22c0acd4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_04ea83a062c64d7068af56b22c0acd4d.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fd8%252F9cd85be278ad2375e7719f924567ae4e%252Fpa%252FLA34369_3c1d36ff7e148af3f22e03fdede8cb31.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_3c1d36ff7e148af3f22e03fdede8cb31.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fd8%252F9cd85be278ad2375e7719f924567ae4e%252Fpa%252FLA34369_c8844be9993f9e89c9ed1b7c4dd69d30.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_c8844be9993f9e89c9ed1b7c4dd69d30.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fd8%252F9cd85be278ad2375e7719f924567ae4e%252Fpa%252FLA34369_f9a632bdac17f2e3354b5bd574af36ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_f9a632bdac17f2e3354b5bd574af36ef.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fd8%252F9cd85be278ad2375e7719f924567ae4e%252Fpa%252FLA34369_c6c4b6f55de1f1b9c8b4e5d25b35f6af.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_c6c4b6f55de1f1b9c8b4e5d25b35f6af.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fd8%252F9cd85be278ad2375e7719f924567ae4e%252Fpa%252FLA34369_9c3bcf7eb29b01aa699a86986b39a0c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_9c3bcf7eb29b01aa699a86986b39a0c8.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fd8%252F9cd85be278ad2375e7719f924567ae4e%252Fpa%252FLA34369_58ee4964fe9eec7dfd69aa768a190d40.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_58ee4964fe9eec7dfd69aa768a190d40.jpg already downloaded
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fd8%252F9cd85be278ad2375e7719f924567ae4e%252Fpa%252FLA34369_9e35d5a30ba7fa1636d63535661577bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_9e35d5a30ba7fa1636d63535661577bc.jpg already downloaded
2026-03-30 09:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: adc4095f-81b5-5549-89a2-b8cd71eb7542, identifier: LA34369
2026-03-30 09:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_f5c9f13a37db7726df685173150dc0a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:31 [auto1.it] INFO: Found listing with ID: AP34592
2026-03-30 09:06:31 [auto1.it] INFO: Found listing with ID: SC36989
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC36989%27 HTTP/1.1" 200 None
2026-03-30 09:06:31 [auto1.it] INFO: Scrape type for SC36989: 1
2026-03-30 09:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_21542575ad6c8d202b99abe07c9ebc66.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_21542575ad6c8d202b99abe07c9ebc66.jpg not downloaded yet
2026-03-30 09:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 138e4383-6c68-5c8e-8f52-78f6131b1bd8 with identifier: KJ64307
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 09:06:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 138e4383-6c68-5c8e-8f52-78f6131b1bd8 with identifier: KJ64307
2026-03-30 09:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 138e4383-6c68-5c8e-8f52-78f6131b1bd8 with identifier: KJ64307 to the API
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KJ64307>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:32:14Z',
 'fuel_type': 'hybrid',
 'id': '138e4383-6c68-5c8e-8f52-78f6131b1bd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ64307',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 30829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_15ec962100365c7f968705986e61ff15.jpg',
                'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_cb16a5dc714562e510045e077af0d671.jpg',
                'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_cc1aaed0669c0b8a7e8617019a0deb46.jpg',
                'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_f9306eb8b8638aab94a254ec0bde7799.jpg',
                'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_3da01d2c4483593aaa4bb523ea201910.jpg',
                'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_c135a31bcda784bd150f29964a7bf448.jpg',
                'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_f836c78228b08c23300a5c7ac0559ce0.jpg',
                'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_f27f1db58d72f37d02cd96cc7167559f.jpg',
                'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_fcaca66d9c945cdbd41bd70bf8555865.jpg',
                'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_11fa31165e2b7d9a509fdd63a409e9fa.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138e4383-6c68-5c8e-8f52-78f6131b1bd8/138e4383-6c68-5c8e-8f52-78f6131b1bd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_15ec962100365c7f968705986e61ff15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138e4383-6c68-5c8e-8f52-78f6131b1bd8/138e4383-6c68-5c8e-8f52-78f6131b1bd8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_cb16a5dc714562e510045e077af0d671.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138e4383-6c68-5c8e-8f52-78f6131b1bd8/138e4383-6c68-5c8e-8f52-78f6131b1bd8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_cc1aaed0669c0b8a7e8617019a0deb46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138e4383-6c68-5c8e-8f52-78f6131b1bd8/138e4383-6c68-5c8e-8f52-78f6131b1bd8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_f9306eb8b8638aab94a254ec0bde7799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138e4383-6c68-5c8e-8f52-78f6131b1bd8/138e4383-6c68-5c8e-8f52-78f6131b1bd8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_3da01d2c4483593aaa4bb523ea201910.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138e4383-6c68-5c8e-8f52-78f6131b1bd8/138e4383-6c68-5c8e-8f52-78f6131b1bd8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_c135a31bcda784bd150f29964a7bf448.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138e4383-6c68-5c8e-8f52-78f6131b1bd8/138e4383-6c68-5c8e-8f52-78f6131b1bd8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_f836c78228b08c23300a5c7ac0559ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138e4383-6c68-5c8e-8f52-78f6131b1bd8/138e4383-6c68-5c8e-8f52-78f6131b1bd8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_f27f1db58d72f37d02cd96cc7167559f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138e4383-6c68-5c8e-8f52-78f6131b1bd8/138e4383-6c68-5c8e-8f52-78f6131b1bd8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_fcaca66d9c945cdbd41bd70bf8555865.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_138e4383-6c68-5c8e-8f52-78f6131b1bd8/138e4383-6c68-5c8e-8f52-78f6131b1bd8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/6b/7c6b02728c82082118780992c8a21a68/pa/KJ64307_11fa31165e2b7d9a509fdd63a409e9fa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Premiere Edition',
 'transmission': 'automatic',
 'trim': '2WD Premiere Edition',
 'year': 2022}
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ64307%27 HTTP/1.1" 200 None
2026-03-30 09:06:32 [auto1.it] INFO: Saving data for KJ64307: {'created_time': 1774861592.641259, 'last_price_update_time': 1774861592.641271, 'auction_closing_time': 1774971134.0}
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KJ64307') HTTP/1.1" 204 0
2026-03-30 09:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: adc4095f-81b5-5549-89a2-b8cd71eb7542 with identifier: LA34369
2026-03-30 09:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: adc4095f-81b5-5549-89a2-b8cd71eb7542 with identifier: LA34369
2026-03-30 09:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: adc4095f-81b5-5549-89a2-b8cd71eb7542 with identifier: LA34369 to the API
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA34369>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:52Z',
 'fuel_type': 'diesel',
 'id': 'adc4095f-81b5-5549-89a2-b8cd71eb7542',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA34369',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 139722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_8082f96701737bb28f97bc5b13ac3d26.jpg',
                'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_4f6fe6394ed57bc2f71dd9d56fdc63b5.jpg',
                'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_04ea83a062c64d7068af56b22c0acd4d.jpg',
                'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_3c1d36ff7e148af3f22e03fdede8cb31.jpg',
                'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_c8844be9993f9e89c9ed1b7c4dd69d30.jpg',
                'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_f9a632bdac17f2e3354b5bd574af36ef.jpg',
                'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_c6c4b6f55de1f1b9c8b4e5d25b35f6af.jpg',
                'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_9c3bcf7eb29b01aa699a86986b39a0c8.jpg',
                'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_58ee4964fe9eec7dfd69aa768a190d40.jpg',
                'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_9e35d5a30ba7fa1636d63535661577bc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adc4095f-81b5-5549-89a2-b8cd71eb7542/adc4095f-81b5-5549-89a2-b8cd71eb7542_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_8082f96701737bb28f97bc5b13ac3d26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adc4095f-81b5-5549-89a2-b8cd71eb7542/adc4095f-81b5-5549-89a2-b8cd71eb7542_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_4f6fe6394ed57bc2f71dd9d56fdc63b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adc4095f-81b5-5549-89a2-b8cd71eb7542/adc4095f-81b5-5549-89a2-b8cd71eb7542_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_04ea83a062c64d7068af56b22c0acd4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adc4095f-81b5-5549-89a2-b8cd71eb7542/adc4095f-81b5-5549-89a2-b8cd71eb7542_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_3c1d36ff7e148af3f22e03fdede8cb31.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adc4095f-81b5-5549-89a2-b8cd71eb7542/adc4095f-81b5-5549-89a2-b8cd71eb7542_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_c8844be9993f9e89c9ed1b7c4dd69d30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adc4095f-81b5-5549-89a2-b8cd71eb7542/adc4095f-81b5-5549-89a2-b8cd71eb7542_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4776409,
             'Height': 3456,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_f9a632bdac17f2e3354b5bd574af36ef.jpg',
             'Width': 3888},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adc4095f-81b5-5549-89a2-b8cd71eb7542/adc4095f-81b5-5549-89a2-b8cd71eb7542_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4416408,
             'Height': 3456,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_c6c4b6f55de1f1b9c8b4e5d25b35f6af.jpg',
             'Width': 3501},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adc4095f-81b5-5549-89a2-b8cd71eb7542/adc4095f-81b5-5549-89a2-b8cd71eb7542_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3578119,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_9c3bcf7eb29b01aa699a86986b39a0c8.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adc4095f-81b5-5549-89a2-b8cd71eb7542/adc4095f-81b5-5549-89a2-b8cd71eb7542_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_58ee4964fe9eec7dfd69aa768a190d40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adc4095f-81b5-5549-89a2-b8cd71eb7542/adc4095f-81b5-5549-89a2-b8cd71eb7542_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3818208,
             'Height': 3456,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/d8/9cd85be278ad2375e7719f924567ae4e/pa/LA34369_9e35d5a30ba7fa1636d63535661577bc.jpg',
             'Width': 4608}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Ambition 4x4',
 'transmission': 'automatic',
 'trim': 'Ambition 4x4',
 'year': 2021}
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA34369%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [auto1.it] INFO: Saving data for LA34369: {'created_time': 1774861593.059654, 'last_price_update_time': 1774861593.059667, 'auction_closing_time': 1774970632.0}
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LA34369') HTTP/1.1" 204 0
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F61%252F7e614605ef038547fe98ba9fabad693a%252Fpa%252FEC41125_cc4dbd81a5bbd9d617a1e114f3fa0f2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_cc4dbd81a5bbd9d617a1e114f3fa0f2b.jpg not downloaded yet
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_f79372e5d6973f4945deebdb56ba55c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_f79372e5d6973f4945deebdb56ba55c1.jpg not downloaded yet
2026-03-30 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA46971/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_5ed9ce3181b3a38616069abb031745c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:33 [auto1.it] INFO: Found listing with ID: SB02789
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB02789%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [auto1.it] INFO: Scrape type for SB02789: 2
2026-03-30 09:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0139d75e-94f3-581b-8cfc-abbe48bbde84 with identifier: SB02789
2026-03-30 09:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0139d75e-94f3-581b-8cfc-abbe48bbde84 with scrape type 2
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0139d75e-94f3-581b-8cfc-abbe48bbde84 with scrape type 2
2026-03-30 09:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0139d75e-94f3-581b-8cfc-abbe48bbde84, identifier: SB02789
2026-03-30 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX35107/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW53113> (referer: https://www.auto1.com/v1/car-details-view/FW53113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48d0210>
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_ea50b035a2230776dfb78ec18e55cdc3.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_ea50b035a2230776dfb78ec18e55cdc3.jpg saved to cache
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5887a42d-53a5-559d-a387-e5c6577c131c
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13834d0>
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_3f1e0d3dc4bfb3e77558f79a6e7ef7fe.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3f1e0d3dc4bfb3e77558f79a6e7ef7fe.jpg saved to cache
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5887a42d-53a5-559d-a387-e5c6577c131c
2026-03-30 09:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_b7925c4fbce39dfe2de02027219965fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0139d75e-94f3-581b-8cfc-abbe48bbde84 with identifier: SB02789
2026-03-30 09:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0139d75e-94f3-581b-8cfc-abbe48bbde84 with identifier: SB02789
2026-03-30 09:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0139d75e-94f3-581b-8cfc-abbe48bbde84 with identifier: SB02789 to the API
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:44:23Z',
 'fuel_type': 'diesel',
 'id': '0139d75e-94f3-581b-8cfc-abbe48bbde84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB02789',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 113087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 R-Design 2WD',
 'transmission': 'automatic',
 'trim': 'R-Design 2WD',
 'year': 2019}
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB02789%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [auto1.it] INFO: Saving data for SB02789: {'auction_closing_time': 1774971863.0, 'created_time': 1773135732.571119, 'last_price_update_time': 1774861593.756175}
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SB02789') HTTP/1.1" 204 0
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F61%252F7e614605ef038547fe98ba9fabad693a%252Fpa%252FEC41125_71f0e0dbd651189e8d03f376adb1875f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_71f0e0dbd651189e8d03f376adb1875f.jpg not downloaded yet
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_e048047f59d828e9dd4b1aa4b67fdddf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_e048047f59d828e9dd4b1aa4b67fdddf.jpg not downloaded yet
2026-03-30 09:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_dd02dd9e6ee7defc2d30a0c86b013f9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:33 [auto1.it] INFO: Found listing with ID: JY89791
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY89791%27 HTTP/1.1" 200 None
2026-03-30 09:06:33 [auto1.it] INFO: Scrape type for JY89791: 2
2026-03-30 09:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68dfe147-4d44-5d4b-a51e-dd8de12c38a2 with identifier: JY89791
2026-03-30 09:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68dfe147-4d44-5d4b-a51e-dd8de12c38a2 with scrape type 2
2026-03-30 09:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68dfe147-4d44-5d4b-a51e-dd8de12c38a2 with scrape type 2
2026-03-30 09:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 68dfe147-4d44-5d4b-a51e-dd8de12c38a2, identifier: JY89791
2026-03-30 09:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2740550>
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_f5c9f13a37db7726df685173150dc0a2.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_f5c9f13a37db7726df685173150dc0a2.jpg saved to cache
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5887a42d-53a5-559d-a387-e5c6577c131c
2026-03-30 09:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_f6f38ed2d2c4d860cc98f220acbca7b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_1476ae1a335cac1a2a90b2836ec4d217.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 68dfe147-4d44-5d4b-a51e-dd8de12c38a2 with identifier: JY89791
2026-03-30 09:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 68dfe147-4d44-5d4b-a51e-dd8de12c38a2 with identifier: JY89791
2026-03-30 09:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 68dfe147-4d44-5d4b-a51e-dd8de12c38a2 with identifier: JY89791 to the API
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:16:59Z',
 'fuel_type': 'petrol',
 'id': '68dfe147-4d44-5d4b-a51e-dd8de12c38a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY89791',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 96529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY89791%27 HTTP/1.1" 200 None
2026-03-30 09:06:34 [auto1.it] INFO: Saving data for JY89791: {'auction_closing_time': 1774970219.0, 'created_time': 1772655429.907961, 'last_price_update_time': 1774861594.421668}
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JY89791') HTTP/1.1" 204 0
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F61%252F7e614605ef038547fe98ba9fabad693a%252Fpa%252FEC41125_ebdbe7fdb7a4c6cbd278d10737c7cc5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_ebdbe7fdb7a4c6cbd278d10737c7cc5b.jpg not downloaded yet
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_c7ba71b221e9728abfd2677510946d7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_c7ba71b221e9728abfd2677510946d7a.jpg not downloaded yet
2026-03-30 09:06:34 [auto1.it] INFO: Found listing with ID: JW12338
2026-03-30 09:06:34 [auto1.it] INFO: Found listing with ID: NM25004
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM25004%27 HTTP/1.1" 200 None
2026-03-30 09:06:34 [auto1.it] INFO: Scrape type for NM25004: 2
2026-03-30 09:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 973b207c-e37b-517c-ba90-1eb9138db4c0 with identifier: NM25004
2026-03-30 09:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 973b207c-e37b-517c-ba90-1eb9138db4c0 with scrape type 2
2026-03-30 09:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 973b207c-e37b-517c-ba90-1eb9138db4c0 with scrape type 2
2026-03-30 09:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 973b207c-e37b-517c-ba90-1eb9138db4c0, identifier: NM25004
2026-03-30 09:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_21542575ad6c8d202b99abe07c9ebc66.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 973b207c-e37b-517c-ba90-1eb9138db4c0 with identifier: NM25004
2026-03-30 09:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 973b207c-e37b-517c-ba90-1eb9138db4c0 with identifier: NM25004
2026-03-30 09:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 973b207c-e37b-517c-ba90-1eb9138db4c0 with identifier: NM25004 to the API
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:37:17Z',
 'fuel_type': 'petrol',
 'id': '973b207c-e37b-517c-ba90-1eb9138db4c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM25004',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 112582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM25004%27 HTTP/1.1" 200 None
2026-03-30 09:06:35 [auto1.it] INFO: Saving data for NM25004: {'auction_closing_time': 1774971437.0, 'created_time': 1772784044.470627, 'last_price_update_time': 1774861595.02648}
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NM25004') HTTP/1.1" 204 0
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F61%252F7e614605ef038547fe98ba9fabad693a%252Fpa%252FEC41125_d99c8854a46cf7640fe2704e7f46fa15.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_d99c8854a46cf7640fe2704e7f46fa15.jpg not downloaded yet
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_750bf30d9d6c6e0ec47af8cc7ed0d70f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_750bf30d9d6c6e0ec47af8cc7ed0d70f.jpg not downloaded yet
2026-03-30 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH99570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2688990>
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_5ed9ce3181b3a38616069abb031745c9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_5ed9ce3181b3a38616069abb031745c9.jpg saved to cache
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5887a42d-53a5-559d-a387-e5c6577c131c
2026-03-30 09:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a90b2bd7-b7ed-59ef-979c-3fd1a4f72752 with identifier: FW53113
2026-03-30 09:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752 with scrape type 1
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_f94452c6ce1bb88f96fe608dd22b9d3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_f94452c6ce1bb88f96fe608dd22b9d3a.jpg not downloaded yet
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee120a990>
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_b7925c4fbce39dfe2de02027219965fe.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_b7925c4fbce39dfe2de02027219965fe.jpg saved to cache
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34df70c4-3a7e-5022-913d-5811e4275b13
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1124e10>
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_dd02dd9e6ee7defc2d30a0c86b013f9d.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_dd02dd9e6ee7defc2d30a0c86b013f9d.jpg saved to cache
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5887a42d-53a5-559d-a387-e5c6577c131c
2026-03-30 09:06:35 [auto1.it] INFO: Found listing with ID: KE87600
2026-03-30 09:06:35 [auto1.it] INFO: Found listing with ID: GK84881
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK84881%27 HTTP/1.1" 200 None
2026-03-30 09:06:35 [auto1.it] INFO: Scrape type for GK84881: 1
2026-03-30 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_cc4dbd81a5bbd9d617a1e114f3fa0f2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_b54177369f48994b971e6297dfd782e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_b54177369f48994b971e6297dfd782e3.jpg not downloaded yet
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_e85d9d91eb8e2099e0378ea177dade9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_e85d9d91eb8e2099e0378ea177dade9c.jpg not downloaded yet
2026-03-30 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY30987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee141ab50>
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_f6f38ed2d2c4d860cc98f220acbca7b9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_f6f38ed2d2c4d860cc98f220acbca7b9.jpg saved to cache
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c82e4378-9bce-5734-95c1-38ad22eef594
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27257d0>
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_1476ae1a335cac1a2a90b2836ec4d217.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_1476ae1a335cac1a2a90b2836ec4d217.jpg saved to cache
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5887a42d-53a5-559d-a387-e5c6577c131c
2026-03-30 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_f79372e5d6973f4945deebdb56ba55c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_42538f2a4d773eb310573172ac0f989d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:35 [auto1.it] INFO: Found listing with ID: UT34552
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT34552%27 HTTP/1.1" 200 None
2026-03-30 09:06:35 [auto1.it] INFO: Scrape type for UT34552: 2
2026-03-30 09:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4107f8fa-85ed-5e25-ae61-b090efc02e7f with identifier: UT34552
2026-03-30 09:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4107f8fa-85ed-5e25-ae61-b090efc02e7f with scrape type 2
2026-03-30 09:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4107f8fa-85ed-5e25-ae61-b090efc02e7f with scrape type 2
2026-03-30 09:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4107f8fa-85ed-5e25-ae61-b090efc02e7f, identifier: UT34552
2026-03-30 09:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY43100/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4107f8fa-85ed-5e25-ae61-b090efc02e7f with identifier: UT34552
2026-03-30 09:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4107f8fa-85ed-5e25-ae61-b090efc02e7f with identifier: UT34552
2026-03-30 09:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4107f8fa-85ed-5e25-ae61-b090efc02e7f with identifier: UT34552 to the API
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:05:09Z',
 'fuel_type': 'diesel',
 'id': '4107f8fa-85ed-5e25-ae61-b090efc02e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT34552',
 'listing': 'auction',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 167144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-28',
 'seller_name': None,
 'title': 'Iveco Daily 2.3 Diesel Einzelkabine 35 C Radstand 3750',
 'transmission': 'manual',
 'trim': 'Einzelkabine 35 C Radstand 3750',
 'year': 2020}
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT34552%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [auto1.it] INFO: Saving data for UT34552: {'auction_closing_time': 1774969509.0, 'created_time': 1773134693.038623, 'last_price_update_time': 1774861596.112213}
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UT34552') HTTP/1.1" 204 0
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_74debfb065ecb473d80dca1246620290.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_74debfb065ecb473d80dca1246620290.jpg not downloaded yet
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_7c90a53545cda8660a6b11b1d31bc834.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_7c90a53545cda8660a6b11b1d31bc834.jpg not downloaded yet
2026-03-30 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_e048047f59d828e9dd4b1aa4b67fdddf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP33572/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10aa7d0>
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_21542575ad6c8d202b99abe07c9ebc66.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_21542575ad6c8d202b99abe07c9ebc66.jpg saved to cache
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5887a42d-53a5-559d-a387-e5c6577c131c
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee286dad0>
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e848de3e-3954-5fa3-af77-edb206202567/e848de3e-3954-5fa3-af77-edb206202567_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F61%252F7e614605ef038547fe98ba9fabad693a%252Fpa%252FEC41125_cc4dbd81a5bbd9d617a1e114f3fa0f2b.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_cc4dbd81a5bbd9d617a1e114f3fa0f2b.jpg saved to cache
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e848de3e-3954-5fa3-af77-edb206202567
2026-03-30 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_f94452c6ce1bb88f96fe608dd22b9d3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_71f0e0dbd651189e8d03f376adb1875f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_260d0b48169339dcf09818cb05bb7ff1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_260d0b48169339dcf09818cb05bb7ff1.jpg not downloaded yet
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_917d0e384c9dc18d09c4a73fab9b196e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_917d0e384c9dc18d09c4a73fab9b196e.jpg not downloaded yet
2026-03-30 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_dbd4cc8bc06c0c826556b589e03dda6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_c7ba71b221e9728abfd2677510946d7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_0286ee565fd2d626ee02c137cae6bbb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_0286ee565fd2d626ee02c137cae6bbb9.jpg not downloaded yet
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_902a28bdfd56552f60fdb845fa9bb610.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_902a28bdfd56552f60fdb845fa9bb610.jpg not downloaded yet
2026-03-30 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC36989/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee109d750>
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_f79372e5d6973f4945deebdb56ba55c1.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_f79372e5d6973f4945deebdb56ba55c1.jpg saved to cache
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2607550>
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_42538f2a4d773eb310573172ac0f989d.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_42538f2a4d773eb310573172ac0f989d.jpg saved to cache
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee137fc10>
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_e048047f59d828e9dd4b1aa4b67fdddf.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_e048047f59d828e9dd4b1aa4b67fdddf.jpg saved to cache
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1
2026-03-30 09:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_e85d9d91eb8e2099e0378ea177dade9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_73adea9fd36db027da3bac272de5ffb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_73adea9fd36db027da3bac272de5ffb1.jpg not downloaded yet
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_62c19b90ed9428827a183e1eef6ca868.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_62c19b90ed9428827a183e1eef6ca868.jpg not downloaded yet
2026-03-30 09:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_750bf30d9d6c6e0ec47af8cc7ed0d70f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1091d90>
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_f94452c6ce1bb88f96fe608dd22b9d3a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_f94452c6ce1bb88f96fe608dd22b9d3a.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2738cd0>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e848de3e-3954-5fa3-af77-edb206202567/e848de3e-3954-5fa3-af77-edb206202567_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F61%252F7e614605ef038547fe98ba9fabad693a%252Fpa%252FEC41125_71f0e0dbd651189e8d03f376adb1875f.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_71f0e0dbd651189e8d03f376adb1875f.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e848de3e-3954-5fa3-af77-edb206202567
2026-03-30 09:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee111b050>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_dbd4cc8bc06c0c826556b589e03dda6c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_dbd4cc8bc06c0c826556b589e03dda6c.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c82e4378-9bce-5734-95c1-38ad22eef594
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13ca990>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_c7ba71b221e9728abfd2677510946d7a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_c7ba71b221e9728abfd2677510946d7a.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_7c90a53545cda8660a6b11b1d31bc834.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_b54177369f48994b971e6297dfd782e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_e3b222cf0a0aa158998f254c9ec7525a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_e3b222cf0a0aa158998f254c9ec7525a.jpg not downloaded yet
2026-03-30 09:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ef0d836d0>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_e85d9d91eb8e2099e0378ea177dade9c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_e85d9d91eb8e2099e0378ea177dade9c.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_74debfb065ecb473d80dca1246620290.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_d99c8854a46cf7640fe2704e7f46fa15.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_a3597447b56ab0c67def186ecbe136e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_a3597447b56ab0c67def186ecbe136e6.jpg not downloaded yet
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13ca250>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_750bf30d9d6c6e0ec47af8cc7ed0d70f.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_750bf30d9d6c6e0ec47af8cc7ed0d70f.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_fe265bbe6defd8c80e39643f328600bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_917d0e384c9dc18d09c4a73fab9b196e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_77ea563d1e279bb9c7d7b423a1d91b4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_77ea563d1e279bb9c7d7b423a1d91b4f.jpg not downloaded yet
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12ead10>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_7c90a53545cda8660a6b11b1d31bc834.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_7c90a53545cda8660a6b11b1d31bc834.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26722d0>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_b54177369f48994b971e6297dfd782e3.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_b54177369f48994b971e6297dfd782e3.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_62c19b90ed9428827a183e1eef6ca868.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX35107> (referer: https://www.auto1.com/v1/car-details-view/RX35107/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_a421998c4cb6d3ee4133da0964889170.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_a421998c4cb6d3ee4133da0964889170.jpg not downloaded yet
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24f3f50>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_74debfb065ecb473d80dca1246620290.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_74debfb065ecb473d80dca1246620290.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11009d0>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e848de3e-3954-5fa3-af77-edb206202567/e848de3e-3954-5fa3-af77-edb206202567_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F61%252F7e614605ef038547fe98ba9fabad693a%252Fpa%252FEC41125_d99c8854a46cf7640fe2704e7f46fa15.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_d99c8854a46cf7640fe2704e7f46fa15.jpg saved to cache
2026-03-30 09:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e848de3e-3954-5fa3-af77-edb206202567
2026-03-30 09:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_260d0b48169339dcf09818cb05bb7ff1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-30 09:06:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-30 09:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00:\x1b\xca\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xe5\xad\x009\x90\xa0\x00\x00\x00\x00'
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26358d0>
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_0.mpo HTTP/1.1" 201 0
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_fe265bbe6defd8c80e39643f328600bb.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_fe265bbe6defd8c80e39643f328600bb.jpg saved to cache
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37a65657-0884-595c-9188-1906d489adba
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1486d50>
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_917d0e384c9dc18d09c4a73fab9b196e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_917d0e384c9dc18d09c4a73fab9b196e.jpg saved to cache
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752
2026-03-30 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_e3b222cf0a0aa158998f254c9ec7525a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_a3597447b56ab0c67def186ecbe136e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_902a28bdfd56552f60fdb845fa9bb610.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_73adea9fd36db027da3bac272de5ffb1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK84881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA46971> (referer: https://www.auto1.com/v1/car-details-view/JA46971/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD90362> (referer: https://www.auto1.com/v1/car-details-view/FD90362/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee287b8d0>
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_62c19b90ed9428827a183e1eef6ca868.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_62c19b90ed9428827a183e1eef6ca868.jpg saved to cache
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752
2026-03-30 09:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ec215a4-e59f-5f40-a078-f6ebc83ed366 with identifier: RX35107
2026-03-30 09:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ec215a4-e59f-5f40-a078-f6ebc83ed366 with scrape type 1
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ec215a4-e59f-5f40-a078-f6ebc83ed366
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F75%252F19750bbe34e97e8196345e764ae9d93a%252Fpa%252FRX35107_e62a2a0ed6d7b94fedef31621dacc703.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_e62a2a0ed6d7b94fedef31621dacc703.jpg already downloaded
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F75%252F19750bbe34e97e8196345e764ae9d93a%252Fpa%252FRX35107_e7294dda2d2eb5883fab309caa4444af.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_e7294dda2d2eb5883fab309caa4444af.jpg already downloaded
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F75%252F19750bbe34e97e8196345e764ae9d93a%252Fpa%252FRX35107_7d25f9b05a6a8fc935c45c27b09b7118.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_7d25f9b05a6a8fc935c45c27b09b7118.jpg already downloaded
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F75%252F19750bbe34e97e8196345e764ae9d93a%252Fpa%252FRX35107_5e0fc8b3b13e7902e12d85387bb0eb6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_5e0fc8b3b13e7902e12d85387bb0eb6d.jpg already downloaded
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F75%252F19750bbe34e97e8196345e764ae9d93a%252Fpa%252FRX35107_ae02d8c87b2387a338ec9a1d591e57d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_ae02d8c87b2387a338ec9a1d591e57d2.jpg already downloaded
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F75%252F19750bbe34e97e8196345e764ae9d93a%252Fpa%252FRX35107_5b1293cb54a96294c7e436a35201bf21.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_5b1293cb54a96294c7e436a35201bf21.jpg already downloaded
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F75%252F19750bbe34e97e8196345e764ae9d93a%252Fpa%252FRX35107_df03055be695a0c2dedf6242bc322e91.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_df03055be695a0c2dedf6242bc322e91.jpg already downloaded
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F75%252F19750bbe34e97e8196345e764ae9d93a%252Fpa%252FRX35107_1208f15d3fc5b3c1cceaba741ab5f2aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_1208f15d3fc5b3c1cceaba741ab5f2aa.jpg already downloaded
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F75%252F19750bbe34e97e8196345e764ae9d93a%252Fpa%252FRX35107_3acf369dd92e8f083af96037252a0d9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_3acf369dd92e8f083af96037252a0d9d.jpg already downloaded
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F75%252F19750bbe34e97e8196345e764ae9d93a%252Fpa%252FRX35107_32149ccdf42eed448bcb6e299ac143c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_32149ccdf42eed448bcb6e299ac143c3.jpg already downloaded
2026-03-30 09:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7ec215a4-e59f-5f40-a078-f6ebc83ed366, identifier: RX35107
2026-03-30 09:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_0286ee565fd2d626ee02c137cae6bbb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7ec215a4-e59f-5f40-a078-f6ebc83ed366 with identifier: RX35107
2026-03-30 09:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7ec215a4-e59f-5f40-a078-f6ebc83ed366 with identifier: RX35107
2026-03-30 09:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7ec215a4-e59f-5f40-a078-f6ebc83ed366 with identifier: RX35107 to the API
2026-03-30 09:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX35107>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:39:33Z',
 'fuel_type': 'petrol',
 'id': '7ec215a4-e59f-5f40-a078-f6ebc83ed366',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX35107',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 126039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_e62a2a0ed6d7b94fedef31621dacc703.jpg',
                'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_e7294dda2d2eb5883fab309caa4444af.jpg',
                'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_7d25f9b05a6a8fc935c45c27b09b7118.jpg',
                'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_5e0fc8b3b13e7902e12d85387bb0eb6d.jpg',
                'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_ae02d8c87b2387a338ec9a1d591e57d2.jpg',
                'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_5b1293cb54a96294c7e436a35201bf21.jpg',
                'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_df03055be695a0c2dedf6242bc322e91.jpg',
                'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_1208f15d3fc5b3c1cceaba741ab5f2aa.jpg',
                'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_3acf369dd92e8f083af96037252a0d9d.jpg',
                'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_32149ccdf42eed448bcb6e299ac143c3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec215a4-e59f-5f40-a078-f6ebc83ed366/7ec215a4-e59f-5f40-a078-f6ebc83ed366_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_e62a2a0ed6d7b94fedef31621dacc703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec215a4-e59f-5f40-a078-f6ebc83ed366/7ec215a4-e59f-5f40-a078-f6ebc83ed366_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3530651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_e7294dda2d2eb5883fab309caa4444af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec215a4-e59f-5f40-a078-f6ebc83ed366/7ec215a4-e59f-5f40-a078-f6ebc83ed366_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3298056,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_7d25f9b05a6a8fc935c45c27b09b7118.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec215a4-e59f-5f40-a078-f6ebc83ed366/7ec215a4-e59f-5f40-a078-f6ebc83ed366_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2771944,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_5e0fc8b3b13e7902e12d85387bb0eb6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec215a4-e59f-5f40-a078-f6ebc83ed366/7ec215a4-e59f-5f40-a078-f6ebc83ed366_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3269637,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_ae02d8c87b2387a338ec9a1d591e57d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec215a4-e59f-5f40-a078-f6ebc83ed366/7ec215a4-e59f-5f40-a078-f6ebc83ed366_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3223189,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_5b1293cb54a96294c7e436a35201bf21.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec215a4-e59f-5f40-a078-f6ebc83ed366/7ec215a4-e59f-5f40-a078-f6ebc83ed366_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3003917,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_df03055be695a0c2dedf6242bc322e91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec215a4-e59f-5f40-a078-f6ebc83ed366/7ec215a4-e59f-5f40-a078-f6ebc83ed366_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_1208f15d3fc5b3c1cceaba741ab5f2aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec215a4-e59f-5f40-a078-f6ebc83ed366/7ec215a4-e59f-5f40-a078-f6ebc83ed366_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_3acf369dd92e8f083af96037252a0d9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec215a4-e59f-5f40-a078-f6ebc83ed366/7ec215a4-e59f-5f40-a078-f6ebc83ed366_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/75/19750bbe34e97e8196345e764ae9d93a/pa/RX35107_32149ccdf42eed448bcb6e299ac143c3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX35107%27 HTTP/1.1" 200 None
2026-03-30 09:06:39 [auto1.it] INFO: Saving data for RX35107: {'created_time': 1774861599.200686, 'last_price_update_time': 1774861599.200697, 'auction_closing_time': 1774971573.0}
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX35107') HTTP/1.1" 204 0
2026-03-30 09:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_77ea563d1e279bb9c7d7b423a1d91b4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1095f10>
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_260d0b48169339dcf09818cb05bb7ff1.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_260d0b48169339dcf09818cb05bb7ff1.jpg saved to cache
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1
2026-03-30 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC36989> (referer: https://www.auto1.com/v1/car-details-view/SC36989/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY43100> (referer: https://www.auto1.com/v1/car-details-view/WY43100/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP33572> (referer: https://www.auto1.com/v1/car-details-view/JP33572/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee111ba10>
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_e3b222cf0a0aa158998f254c9ec7525a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_e3b222cf0a0aa158998f254c9ec7525a.jpg saved to cache
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee259b590>
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_a3597447b56ab0c67def186ecbe136e6.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_a3597447b56ab0c67def186ecbe136e6.jpg saved to cache
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2736f90>
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_902a28bdfd56552f60fdb845fa9bb610.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_902a28bdfd56552f60fdb845fa9bb610.jpg saved to cache
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee261e250>
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_73adea9fd36db027da3bac272de5ffb1.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_73adea9fd36db027da3bac272de5ffb1.jpg saved to cache
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1
2026-03-30 09:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0122f81b-c76c-586a-ae94-ad42aedf07ee with identifier: JA46971
2026-03-30 09:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0122f81b-c76c-586a-ae94-ad42aedf07ee with scrape type 1
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0122f81b-c76c-586a-ae94-ad42aedf07ee
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_99c6a201dc67363d989a86be39dfabf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_99c6a201dc67363d989a86be39dfabf7.jpg not downloaded yet
2026-03-30 09:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3338be66-0d2b-5217-a485-094598f98b3d with identifier: FD90362
2026-03-30 09:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3338be66-0d2b-5217-a485-094598f98b3d with scrape type 1
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3338be66-0d2b-5217-a485-094598f98b3d
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_61ef88038637966a25d9571e6d009e47.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_61ef88038637966a25d9571e6d009e47.jpg not downloaded yet
2026-03-30 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_a421998c4cb6d3ee4133da0964889170.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_14b4ca9fa61e1e58d25e4edcb3ea02ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_ebdbe7fdb7a4c6cbd278d10737c7cc5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_a7bec62c3407657984f47ab1ec6d46ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a7bec62c3407657984f47ab1ec6d46ef.jpg not downloaded yet
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_295f3559f64f92203b9d939ecbc61206.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_295f3559f64f92203b9d939ecbc61206.jpg not downloaded yet
2026-03-30 09:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2804950>
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fee%252Fc5eec4ce5a942673ed12fb4904d4888f%252Fpa%252FAL20589_0286ee565fd2d626ee02c137cae6bbb9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_0286ee565fd2d626ee02c137cae6bbb9.jpg saved to cache
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1
2026-03-30 09:06:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a700506d-ca0b-5ef4-8c6e-2119701c7ce1, skipping ID generation
2026-03-30 09:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1 with scrape type 1
2026-03-30 09:06:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a700506d-ca0b-5ef4-8c6e-2119701c7ce1 sending to next pipeline
2026-03-30 09:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a700506d-ca0b-5ef4-8c6e-2119701c7ce1, identifier: AL20589
2026-03-30 09:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_00762108c415d1521f01d908a1cf0351.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a700506d-ca0b-5ef4-8c6e-2119701c7ce1 with identifier: AL20589
2026-03-30 09:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a700506d-ca0b-5ef4-8c6e-2119701c7ce1 with identifier: AL20589
2026-03-30 09:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a700506d-ca0b-5ef4-8c6e-2119701c7ce1 with identifier: AL20589 to the API
2026-03-30 09:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_0286ee565fd2d626ee02c137cae6bbb9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:47:43Z',
 'fuel_type': 'petrol',
 'id': 'a700506d-ca0b-5ef4-8c6e-2119701c7ce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL20589',
 'listing': 'auction',
 'location': 'IT, Rozzano',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 83474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_42538f2a4d773eb310573172ac0f989d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_f79372e5d6973f4945deebdb56ba55c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_e048047f59d828e9dd4b1aa4b67fdddf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_c7ba71b221e9728abfd2677510946d7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_750bf30d9d6c6e0ec47af8cc7ed0d70f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_b54177369f48994b971e6297dfd782e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_74debfb065ecb473d80dca1246620290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_260d0b48169339dcf09818cb05bb7ff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_0286ee565fd2d626ee02c137cae6bbb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a700506d-ca0b-5ef4-8c6e-2119701c7ce1/a700506d-ca0b-5ef4-8c6e-2119701c7ce1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/ee/c5eec4ce5a942673ed12fb4904d4888f/pa/AL20589_73adea9fd36db027da3bac272de5ffb1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo GS Line Start/Stop',
 'transmission': 'manual',
 'trim': 'GS Line Start/Stop',
 'year': 2020}
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL20589%27 HTTP/1.1" 200 None
2026-03-30 09:06:40 [auto1.it] INFO: Saving data for AL20589: {'created_time': 1774861600.300901, 'last_price_update_time': 1774861600.300914, 'auction_closing_time': 1774972063.0}
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL20589') HTTP/1.1" 204 0
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_12a929256f9754b8814e34dc165ec8fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_12a929256f9754b8814e34dc165ec8fd.jpg not downloaded yet
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_64186aae62903f069d40ddd82c497cc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_64186aae62903f069d40ddd82c497cc4.jpg not downloaded yet
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee274fb10>
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_77ea563d1e279bb9c7d7b423a1d91b4f.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_77ea563d1e279bb9c7d7b423a1d91b4f.jpg saved to cache
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752
2026-03-30 09:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e58ff75c-8870-52cc-9acd-3f1303e3b574 with identifier: SC36989
2026-03-30 09:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e58ff75c-8870-52cc-9acd-3f1303e3b574 with scrape type 1
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e58ff75c-8870-52cc-9acd-3f1303e3b574
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_09321d4211d9e6d7e03db6c733deb6ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_09321d4211d9e6d7e03db6c733deb6ed.jpg not downloaded yet
2026-03-30 09:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 024995a8-8f63-531a-bfe8-ac37bb551df1 with identifier: WY43100
2026-03-30 09:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 024995a8-8f63-531a-bfe8-ac37bb551df1 with scrape type 1
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 024995a8-8f63-531a-bfe8-ac37bb551df1
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F70%252Fd1702ee988dae58ba0759215ce6c2358%252Fpa%252FWY43100_a556582bba6ac769c8a8441e9e7044a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_a556582bba6ac769c8a8441e9e7044a7.jpg not downloaded yet
2026-03-30 09:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bf85059-ce24-510e-8b4a-0cf19aa11c20 with identifier: JP33572
2026-03-30 09:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20 with scrape type 1
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_1db6f612c8d8bd95e3939970f1402396.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_1db6f612c8d8bd95e3939970f1402396.jpg not downloaded yet
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10ea550>
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Ff4%252F4af477d0c1272916ae9351878bc96349%252Fpa%252FFW53113_a421998c4cb6d3ee4133da0964889170.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_a421998c4cb6d3ee4133da0964889170.jpg saved to cache
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752
2026-03-30 09:06:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a90b2bd7-b7ed-59ef-979c-3fd1a4f72752, skipping ID generation
2026-03-30 09:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752 with scrape type 1
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a90b2bd7-b7ed-59ef-979c-3fd1a4f72752 sending to next pipeline
2026-03-30 09:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a90b2bd7-b7ed-59ef-979c-3fd1a4f72752, identifier: FW53113
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10e2150>
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e848de3e-3954-5fa3-af77-edb206202567/e848de3e-3954-5fa3-af77-edb206202567_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F61%252F7e614605ef038547fe98ba9fabad693a%252Fpa%252FEC41125_14b4ca9fa61e1e58d25e4edcb3ea02ce.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_14b4ca9fa61e1e58d25e4edcb3ea02ce.jpg saved to cache
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e848de3e-3954-5fa3-af77-edb206202567
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1449590>
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e848de3e-3954-5fa3-af77-edb206202567/e848de3e-3954-5fa3-af77-edb206202567_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F61%252F7e614605ef038547fe98ba9fabad693a%252Fpa%252FEC41125_ebdbe7fdb7a4c6cbd278d10737c7cc5b.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_ebdbe7fdb7a4c6cbd278d10737c7cc5b.jpg saved to cache
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e848de3e-3954-5fa3-af77-edb206202567
2026-03-30 09:06:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e848de3e-3954-5fa3-af77-edb206202567, skipping ID generation
2026-03-30 09:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e848de3e-3954-5fa3-af77-edb206202567 with scrape type 1
2026-03-30 09:06:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e848de3e-3954-5fa3-af77-edb206202567 sending to next pipeline
2026-03-30 09:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e848de3e-3954-5fa3-af77-edb206202567, identifier: EC41125
2026-03-30 09:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_2818012c624c02071ec39326f6e0c6e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_c9d7b8b9108968942ad881758d902e85.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_eb3fcd1257b938a85bb713b8c38106c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_eb3fcd1257b938a85bb713b8c38106c5.jpg not downloaded yet
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_d66bdd83f731844e0755a27cfdb12e7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_d66bdd83f731844e0755a27cfdb12e7e.jpg not downloaded yet
2026-03-30 09:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a90b2bd7-b7ed-59ef-979c-3fd1a4f72752 with identifier: FW53113
2026-03-30 09:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a90b2bd7-b7ed-59ef-979c-3fd1a4f72752 with identifier: FW53113
2026-03-30 09:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a90b2bd7-b7ed-59ef-979c-3fd1a4f72752 with identifier: FW53113 to the API
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_a421998c4cb6d3ee4133da0964889170.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:01Z',
 'fuel_type': 'diesel',
 'id': 'a90b2bd7-b7ed-59ef-979c-3fd1a4f72752',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW53113',
 'listing': 'auction',
 'location': 'IT, Vigevano',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 186875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_f94452c6ce1bb88f96fe608dd22b9d3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_e85d9d91eb8e2099e0378ea177dade9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_7c90a53545cda8660a6b11b1d31bc834.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_917d0e384c9dc18d09c4a73fab9b196e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_902a28bdfd56552f60fdb845fa9bb610.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_62c19b90ed9428827a183e1eef6ca868.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_e3b222cf0a0aa158998f254c9ec7525a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_a3597447b56ab0c67def186ecbe136e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_77ea563d1e279bb9c7d7b423a1d91b4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a90b2bd7-b7ed-59ef-979c-3fd1a4f72752/a90b2bd7-b7ed-59ef-979c-3fd1a4f72752_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/f4/4af477d0c1272916ae9351878bc96349/pa/FW53113_a421998c4cb6d3ee4133da0964889170.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW53113%27 HTTP/1.1" 200 None
2026-03-30 09:06:41 [auto1.it] INFO: Saving data for FW53113: {'created_time': 1774861601.431846, 'last_price_update_time': 1774861601.431856, 'auction_closing_time': 1774971961.0}
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FW53113') HTTP/1.1" 204 0
2026-03-30 09:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e848de3e-3954-5fa3-af77-edb206202567 with identifier: EC41125
2026-03-30 09:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e848de3e-3954-5fa3-af77-edb206202567 with identifier: EC41125
2026-03-30 09:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e848de3e-3954-5fa3-af77-edb206202567 with identifier: EC41125 to the API
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_ebdbe7fdb7a4c6cbd278d10737c7cc5b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:46:05Z',
 'fuel_type': 'diesel',
 'id': 'e848de3e-3954-5fa3-af77-edb206202567',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC41125',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 160500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e848de3e-3954-5fa3-af77-edb206202567/e848de3e-3954-5fa3-af77-edb206202567_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_14b4ca9fa61e1e58d25e4edcb3ea02ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e848de3e-3954-5fa3-af77-edb206202567/e848de3e-3954-5fa3-af77-edb206202567_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_cc4dbd81a5bbd9d617a1e114f3fa0f2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e848de3e-3954-5fa3-af77-edb206202567/e848de3e-3954-5fa3-af77-edb206202567_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_71f0e0dbd651189e8d03f376adb1875f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e848de3e-3954-5fa3-af77-edb206202567/e848de3e-3954-5fa3-af77-edb206202567_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_ebdbe7fdb7a4c6cbd278d10737c7cc5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e848de3e-3954-5fa3-af77-edb206202567/e848de3e-3954-5fa3-af77-edb206202567_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/61/7e614605ef038547fe98ba9fabad693a/pa/EC41125_d99c8854a46cf7640fe2704e7f46fa15.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.3 JTD Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2014}
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC41125%27 HTTP/1.1" 200 None
2026-03-30 09:06:41 [auto1.it] INFO: Saving data for EC41125: {'created_time': 1774861601.838663, 'last_price_update_time': 1774861601.838673, 'auction_closing_time': 1774971965.0}
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC41125') HTTP/1.1" 204 0
2026-03-30 09:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_61ef88038637966a25d9571e6d009e47.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_99c6a201dc67363d989a86be39dfabf7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_69fe09db54be6479a135e8e797680580.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_69fe09db54be6479a135e8e797680580.jpg not downloaded yet
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F70%252Fd1702ee988dae58ba0759215ce6c2358%252Fpa%252FWY43100_a3ef0e89b3bcf699ef8ebeae56ce1fa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_a3ef0e89b3bcf699ef8ebeae56ce1fa9.jpg not downloaded yet
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_4d86e028d1a2acdd4aacb891e9e58182.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_4d86e028d1a2acdd4aacb891e9e58182.jpg not downloaded yet
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12fa2d0>
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_00762108c415d1521f01d908a1cf0351.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_00762108c415d1521f01d908a1cf0351.jpg saved to cache
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34df70c4-3a7e-5022-913d-5811e4275b13
2026-03-30 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_c3fff2a881913fdeb00f40acd7a721c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_ed214cefea809b152ba7ae8601ea80a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_ed214cefea809b152ba7ae8601ea80a0.jpg not downloaded yet
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_a10222935b114a83898abb6b9e9e26d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_a10222935b114a83898abb6b9e9e26d3.jpg not downloaded yet
2026-03-30 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH99570> (referer: https://www.auto1.com/v1/car-details-view/YH99570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP59254/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA01979/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_36028c7dd7f9e28dde5ae99d6ec76a3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_36028c7dd7f9e28dde5ae99d6ec76a3f.jpg not downloaded yet
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F70%252Fd1702ee988dae58ba0759215ce6c2358%252Fpa%252FWY43100_4496f099e336f2e75d653f1da20c1f02.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_4496f099e336f2e75d653f1da20c1f02.jpg not downloaded yet
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_d9db616b463d4c0f3fdc4f12534d565e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_d9db616b463d4c0f3fdc4f12534d565e.jpg not downloaded yet
2026-03-30 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY30987> (referer: https://www.auto1.com/v1/car-details-view/EY30987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_eb2f4a9fa0700be0a4694b2984eab5dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_eb2f4a9fa0700be0a4694b2984eab5dd.jpg not downloaded yet
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_eaba5e67be40b703744124c251e27e47.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_eaba5e67be40b703744124c251e27e47.jpg not downloaded yet
2026-03-30 09:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee127fb10>
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_2818012c624c02071ec39326f6e0c6e0.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_2818012c624c02071ec39326f6e0c6e0.jpg saved to cache
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5887a42d-53a5-559d-a387-e5c6577c131c
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2562b50>
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_c9d7b8b9108968942ad881758d902e85.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_c9d7b8b9108968942ad881758d902e85.jpg saved to cache
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34df70c4-3a7e-5022-913d-5811e4275b13
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10e1ad0>
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_61ef88038637966a25d9571e6d009e47.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_61ef88038637966a25d9571e6d009e47.jpg saved to cache
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3338be66-0d2b-5217-a485-094598f98b3d
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12d5950>
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_99c6a201dc67363d989a86be39dfabf7.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_99c6a201dc67363d989a86be39dfabf7.jpg saved to cache
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0122f81b-c76c-586a-ae94-ad42aedf07ee
2026-03-30 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_225e02c06b4de9b8586e4e51fa2bcea3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_406178b897902524ac64b1d781d6720c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_406178b897902524ac64b1d781d6720c.jpg not downloaded yet
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F70%252Fd1702ee988dae58ba0759215ce6c2358%252Fpa%252FWY43100_ca0b694c28b79b809ec53303add7809b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_ca0b694c28b79b809ec53303add7809b.jpg not downloaded yet
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_f7847ad4a34b1ab41e2111779b462472.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_f7847ad4a34b1ab41e2111779b462472.jpg not downloaded yet
2026-03-30 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_a556582bba6ac769c8a8441e9e7044a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_09321d4211d9e6d7e03db6c733deb6ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_a189435de61bbdecc38d48e20b5e112a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a189435de61bbdecc38d48e20b5e112a.jpg not downloaded yet
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_74458c14f2f321ef628627977c23ab00.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_74458c14f2f321ef628627977c23ab00.jpg not downloaded yet
2026-03-30 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_1db6f612c8d8bd95e3939970f1402396.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_d6bff64a741ad84227ff3fd4ee4a0308.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_e14bab2d77866ace6eef5b4529f89b2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_e14bab2d77866ace6eef5b4529f89b2b.jpg not downloaded yet
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F70%252Fd1702ee988dae58ba0759215ce6c2358%252Fpa%252FWY43100_1ea3d83e9f5e002ae5849251f7f21f4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_1ea3d83e9f5e002ae5849251f7f21f4a.jpg not downloaded yet
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_c86c307192bf90b50f994ae2fcb5fe78.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_c86c307192bf90b50f994ae2fcb5fe78.jpg not downloaded yet
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee121ac50>
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_c3fff2a881913fdeb00f40acd7a721c4.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_c3fff2a881913fdeb00f40acd7a721c4.jpg saved to cache
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c82e4378-9bce-5734-95c1-38ad22eef594
2026-03-30 09:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0981e054-2cc0-5e86-b026-e3bcbe4ee41d with identifier: YH99570
2026-03-30 09:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d with scrape type 1
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_d234972c7e7b8e8fe9cc07b6f7746e18.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_d234972c7e7b8e8fe9cc07b6f7746e18.jpg not downloaded yet
2026-03-30 09:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9c79e5-2b8b-5581-8ec4-194ada301e86 with identifier: EY30987
2026-03-30 09:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9c79e5-2b8b-5581-8ec4-194ada301e86 with scrape type 1
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba9c79e5-2b8b-5581-8ec4-194ada301e86
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F16%252F5c16289ba40cfe81b35860f1fa4e4c49%252Fpa%252FEY30987_166ca561e4df45c53e77471c985a4c78.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_166ca561e4df45c53e77471c985a4c78.jpg already downloaded
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F16%252F5c16289ba40cfe81b35860f1fa4e4c49%252Fpa%252FEY30987_cc206cc235b1c35a98432872b2f70088.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_cc206cc235b1c35a98432872b2f70088.jpg already downloaded
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F16%252F5c16289ba40cfe81b35860f1fa4e4c49%252Fpa%252FEY30987_0c04632264ee3cfc2cae142fdd79de8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_0c04632264ee3cfc2cae142fdd79de8e.jpg already downloaded
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F16%252F5c16289ba40cfe81b35860f1fa4e4c49%252Fpa%252FEY30987_3b007c703036c32fee3b836b4c8a4ede.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_3b007c703036c32fee3b836b4c8a4ede.jpg already downloaded
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F16%252F5c16289ba40cfe81b35860f1fa4e4c49%252Fpa%252FEY30987_3efb290a38d1d54f81bbaa4e34fe9989.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_3efb290a38d1d54f81bbaa4e34fe9989.jpg already downloaded
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F16%252F5c16289ba40cfe81b35860f1fa4e4c49%252Fpa%252FEY30987_76ecb7404d61849ff0755c965378a8f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_76ecb7404d61849ff0755c965378a8f4.jpg already downloaded
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F16%252F5c16289ba40cfe81b35860f1fa4e4c49%252Fpa%252FEY30987_a62772ac40be2fcbc29e44ccda4667ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_a62772ac40be2fcbc29e44ccda4667ec.jpg already downloaded
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F16%252F5c16289ba40cfe81b35860f1fa4e4c49%252Fpa%252FEY30987_ff71491889e37a63c51dd4d8753bc0a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_ff71491889e37a63c51dd4d8753bc0a3.jpg already downloaded
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F16%252F5c16289ba40cfe81b35860f1fa4e4c49%252Fpa%252FEY30987_5c925912f83404a1517ae2c3e029c4b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_5c925912f83404a1517ae2c3e029c4b1.jpg already downloaded
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F16%252F5c16289ba40cfe81b35860f1fa4e4c49%252Fpa%252FEY30987_5be1024621b0a2a11883eb3b3971559e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_5be1024621b0a2a11883eb3b3971559e.jpg already downloaded
2026-03-30 09:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ba9c79e5-2b8b-5581-8ec4-194ada301e86, identifier: EY30987
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_95465dcbccd31b04e1be94d3ffb17ebf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_95465dcbccd31b04e1be94d3ffb17ebf.jpg not downloaded yet
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_76ff3fbb5ca375be9f847c3ca328e9b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_76ff3fbb5ca375be9f847c3ca328e9b4.jpg not downloaded yet
2026-03-30 09:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ba9c79e5-2b8b-5581-8ec4-194ada301e86 with identifier: EY30987
2026-03-30 09:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ba9c79e5-2b8b-5581-8ec4-194ada301e86 with identifier: EY30987
2026-03-30 09:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ba9c79e5-2b8b-5581-8ec4-194ada301e86 with identifier: EY30987 to the API
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EY30987>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:48:07Z',
 'fuel_type': 'petrol',
 'id': 'ba9c79e5-2b8b-5581-8ec4-194ada301e86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY30987',
 'listing': 'auction',
 'location': 'IT, Vercelli',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 80326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_166ca561e4df45c53e77471c985a4c78.jpg',
                'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_cc206cc235b1c35a98432872b2f70088.jpg',
                'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_0c04632264ee3cfc2cae142fdd79de8e.jpg',
                'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_3b007c703036c32fee3b836b4c8a4ede.jpg',
                'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_3efb290a38d1d54f81bbaa4e34fe9989.jpg',
                'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_76ecb7404d61849ff0755c965378a8f4.jpg',
                'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_a62772ac40be2fcbc29e44ccda4667ec.jpg',
                'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_ff71491889e37a63c51dd4d8753bc0a3.jpg',
                'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_5c925912f83404a1517ae2c3e029c4b1.jpg',
                'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_5be1024621b0a2a11883eb3b3971559e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9c79e5-2b8b-5581-8ec4-194ada301e86/ba9c79e5-2b8b-5581-8ec4-194ada301e86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2454576,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_166ca561e4df45c53e77471c985a4c78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9c79e5-2b8b-5581-8ec4-194ada301e86/ba9c79e5-2b8b-5581-8ec4-194ada301e86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_cc206cc235b1c35a98432872b2f70088.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9c79e5-2b8b-5581-8ec4-194ada301e86/ba9c79e5-2b8b-5581-8ec4-194ada301e86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2305216,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_0c04632264ee3cfc2cae142fdd79de8e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9c79e5-2b8b-5581-8ec4-194ada301e86/ba9c79e5-2b8b-5581-8ec4-194ada301e86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_3b007c703036c32fee3b836b4c8a4ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9c79e5-2b8b-5581-8ec4-194ada301e86/ba9c79e5-2b8b-5581-8ec4-194ada301e86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_3efb290a38d1d54f81bbaa4e34fe9989.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9c79e5-2b8b-5581-8ec4-194ada301e86/ba9c79e5-2b8b-5581-8ec4-194ada301e86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_76ecb7404d61849ff0755c965378a8f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9c79e5-2b8b-5581-8ec4-194ada301e86/ba9c79e5-2b8b-5581-8ec4-194ada301e86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_a62772ac40be2fcbc29e44ccda4667ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9c79e5-2b8b-5581-8ec4-194ada301e86/ba9c79e5-2b8b-5581-8ec4-194ada301e86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_ff71491889e37a63c51dd4d8753bc0a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9c79e5-2b8b-5581-8ec4-194ada301e86/ba9c79e5-2b8b-5581-8ec4-194ada301e86_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_5c925912f83404a1517ae2c3e029c4b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba9c79e5-2b8b-5581-8ec4-194ada301e86/ba9c79e5-2b8b-5581-8ec4-194ada301e86_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/16/5c16289ba40cfe81b35860f1fa4e4c49/pa/EY30987_5be1024621b0a2a11883eb3b3971559e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka 1.6 Cosmo ecoFlex',
 'transmission': 'manual',
 'trim': 'Cosmo ecoFlex',
 'year': 2014}
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY30987%27 HTTP/1.1" 200 None
2026-03-30 09:06:43 [auto1.it] INFO: Saving data for EY30987: {'created_time': 1774861603.609165, 'last_price_update_time': 1774861603.609175, 'auction_closing_time': 1774972087.0}
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EY30987') HTTP/1.1" 204 0
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_ef7148f07e27bf7677a8abd28e83af37.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_ef7148f07e27bf7677a8abd28e83af37.jpg not downloaded yet
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_c52ba9edd4b9ee7b99b8a6d4f7aee1a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_c52ba9edd4b9ee7b99b8a6d4f7aee1a4.jpg not downloaded yet
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_9f476703a1d8016c157b50e5d7855f2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_9f476703a1d8016c157b50e5d7855f2e.jpg not downloaded yet
2026-03-30 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_a10222935b114a83898abb6b9e9e26d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_5ab689dea87d8ce4ec8fe2e95570691f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_5ab689dea87d8ce4ec8fe2e95570691f.jpg not downloaded yet
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_2cc51f2c2517f84357891c71e62db368.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_2cc51f2c2517f84357891c71e62db368.jpg not downloaded yet
2026-03-30 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN45721/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK84881> (referer: https://www.auto1.com/v1/car-details-view/GK84881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:43 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-30 09:06:43 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-30 09:06:43 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00:W~\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xc5\x08\x009\xd7\xd5\x00\x00\x00\x00'
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1272490>
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_9.mpo HTTP/1.1" 201 0
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_225e02c06b4de9b8586e4e51fa2bcea3.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_225e02c06b4de9b8586e4e51fa2bcea3.jpg saved to cache
2026-03-30 09:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37a65657-0884-595c-9188-1906d489adba
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13b82d0>
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024995a8-8f63-531a-bfe8-ac37bb551df1/024995a8-8f63-531a-bfe8-ac37bb551df1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F70%252Fd1702ee988dae58ba0759215ce6c2358%252Fpa%252FWY43100_a556582bba6ac769c8a8441e9e7044a7.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_a556582bba6ac769c8a8441e9e7044a7.jpg saved to cache
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 024995a8-8f63-531a-bfe8-ac37bb551df1
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee34a6e90>
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_09321d4211d9e6d7e03db6c733deb6ed.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_09321d4211d9e6d7e03db6c733deb6ed.jpg saved to cache
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e58ff75c-8870-52cc-9acd-3f1303e3b574
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13b9750>
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_1db6f612c8d8bd95e3939970f1402396.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_1db6f612c8d8bd95e3939970f1402396.jpg saved to cache
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1206e50>
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_d6bff64a741ad84227ff3fd4ee4a0308.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_d6bff64a741ad84227ff3fd4ee4a0308.jpg saved to cache
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d628d6c2-6eee-5ba7-bf02-527049a3c587
2026-03-30 09:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_4d86e028d1a2acdd4aacb891e9e58182.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_ed214cefea809b152ba7ae8601ea80a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_bfb8e0c6c6ff77273d1aee25d9df84cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_bfb8e0c6c6ff77273d1aee25d9df84cf.jpg not downloaded yet
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_965f0cbdc2732762c27bef65c66801c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_965f0cbdc2732762c27bef65c66801c6.jpg not downloaded yet
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_fddc48335ae2f459dd65ad6d07c2278a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_fddc48335ae2f459dd65ad6d07c2278a.jpg not downloaded yet
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_a09480ced08747545bed795fd20a9d8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a09480ced08747545bed795fd20a9d8f.jpg not downloaded yet
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_8e8303f6a9366032e8b0017f4620e734.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_8e8303f6a9366032e8b0017f4620e734.jpg not downloaded yet
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_ac54acb19bde72706548c0bf0ee40a3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_ac54acb19bde72706548c0bf0ee40a3c.jpg not downloaded yet
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_0ee5970153b3569fb40787bca9c6195e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_0ee5970153b3569fb40787bca9c6195e.jpg not downloaded yet
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_a837985651162cc536be6820a656da70.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_a837985651162cc536be6820a656da70.jpg not downloaded yet
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2669950>
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_a10222935b114a83898abb6b9e9e26d3.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_a10222935b114a83898abb6b9e9e26d3.jpg saved to cache
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3338be66-0d2b-5217-a485-094598f98b3d
2026-03-30 09:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13647ffb-bad0-5d5b-b5a0-b9d6a907b083 with identifier: GK84881
2026-03-30 09:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13647ffb-bad0-5d5b-b5a0-b9d6a907b083 with scrape type 1
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13647ffb-bad0-5d5b-b5a0-b9d6a907b083
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fac%252F55ace7e2f3e03eae4787dbe9b80bb010%252Fpa%252FGK84881_f66da1837607038b8a85f5e3b0bc7079.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_f66da1837607038b8a85f5e3b0bc7079.jpg already downloaded
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fac%252F55ace7e2f3e03eae4787dbe9b80bb010%252Fpa%252FGK84881_5ca071f04691be7918e76359dc275c00.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_5ca071f04691be7918e76359dc275c00.jpg already downloaded
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fac%252F55ace7e2f3e03eae4787dbe9b80bb010%252Fpa%252FGK84881_345af5d55189959d70b5278f69dafd46.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_345af5d55189959d70b5278f69dafd46.jpg already downloaded
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fac%252F55ace7e2f3e03eae4787dbe9b80bb010%252Fpa%252FGK84881_16e7dbfdeec2346da7277db9941008cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_16e7dbfdeec2346da7277db9941008cf.jpg already downloaded
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fac%252F55ace7e2f3e03eae4787dbe9b80bb010%252Fpa%252FGK84881_90b6d7c2410b534a9d38b51276013db7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_90b6d7c2410b534a9d38b51276013db7.jpg already downloaded
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fac%252F55ace7e2f3e03eae4787dbe9b80bb010%252Fpa%252FGK84881_53fe7fcb8c1d779749fdb20b122cefa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_53fe7fcb8c1d779749fdb20b122cefa1.jpg already downloaded
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fac%252F55ace7e2f3e03eae4787dbe9b80bb010%252Fpa%252FGK84881_4aed623b163ca0edfe73722ba6d4eb80.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_4aed623b163ca0edfe73722ba6d4eb80.jpg already downloaded
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fac%252F55ace7e2f3e03eae4787dbe9b80bb010%252Fpa%252FGK84881_348fa2f855559c4cfa79c931f0baad04.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_348fa2f855559c4cfa79c931f0baad04.jpg already downloaded
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fac%252F55ace7e2f3e03eae4787dbe9b80bb010%252Fpa%252FGK84881_80ec32edfc704c5bd42da09c82ea0689.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_80ec32edfc704c5bd42da09c82ea0689.jpg already downloaded
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fac%252F55ace7e2f3e03eae4787dbe9b80bb010%252Fpa%252FGK84881_8ca20261ffeedab2b2f47498360732e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_8ca20261ffeedab2b2f47498360732e3.jpg already downloaded
2026-03-30 09:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 13647ffb-bad0-5d5b-b5a0-b9d6a907b083, identifier: GK84881
2026-03-30 09:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 13647ffb-bad0-5d5b-b5a0-b9d6a907b083 with identifier: GK84881
2026-03-30 09:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 13647ffb-bad0-5d5b-b5a0-b9d6a907b083 with identifier: GK84881
2026-03-30 09:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 13647ffb-bad0-5d5b-b5a0-b9d6a907b083 with identifier: GK84881 to the API
2026-03-30 09:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GK84881>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.5L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-31T15:02:39Z',
 'fuel_type': 'hybrid',
 'id': '13647ffb-bad0-5d5b-b5a0-b9d6a907b083',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK84881',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 62528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_f66da1837607038b8a85f5e3b0bc7079.jpg',
                'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_5ca071f04691be7918e76359dc275c00.jpg',
                'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_345af5d55189959d70b5278f69dafd46.jpg',
                'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_16e7dbfdeec2346da7277db9941008cf.jpg',
                'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_90b6d7c2410b534a9d38b51276013db7.jpg',
                'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_53fe7fcb8c1d779749fdb20b122cefa1.jpg',
                'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_4aed623b163ca0edfe73722ba6d4eb80.jpg',
                'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_348fa2f855559c4cfa79c931f0baad04.jpg',
                'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_80ec32edfc704c5bd42da09c82ea0689.jpg',
                'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_8ca20261ffeedab2b2f47498360732e3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13647ffb-bad0-5d5b-b5a0-b9d6a907b083/13647ffb-bad0-5d5b-b5a0-b9d6a907b083_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_f66da1837607038b8a85f5e3b0bc7079.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13647ffb-bad0-5d5b-b5a0-b9d6a907b083/13647ffb-bad0-5d5b-b5a0-b9d6a907b083_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_5ca071f04691be7918e76359dc275c00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13647ffb-bad0-5d5b-b5a0-b9d6a907b083/13647ffb-bad0-5d5b-b5a0-b9d6a907b083_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_345af5d55189959d70b5278f69dafd46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13647ffb-bad0-5d5b-b5a0-b9d6a907b083/13647ffb-bad0-5d5b-b5a0-b9d6a907b083_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_16e7dbfdeec2346da7277db9941008cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13647ffb-bad0-5d5b-b5a0-b9d6a907b083/13647ffb-bad0-5d5b-b5a0-b9d6a907b083_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_90b6d7c2410b534a9d38b51276013db7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13647ffb-bad0-5d5b-b5a0-b9d6a907b083/13647ffb-bad0-5d5b-b5a0-b9d6a907b083_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_53fe7fcb8c1d779749fdb20b122cefa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13647ffb-bad0-5d5b-b5a0-b9d6a907b083/13647ffb-bad0-5d5b-b5a0-b9d6a907b083_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_4aed623b163ca0edfe73722ba6d4eb80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13647ffb-bad0-5d5b-b5a0-b9d6a907b083/13647ffb-bad0-5d5b-b5a0-b9d6a907b083_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_348fa2f855559c4cfa79c931f0baad04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13647ffb-bad0-5d5b-b5a0-b9d6a907b083/13647ffb-bad0-5d5b-b5a0-b9d6a907b083_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_80ec32edfc704c5bd42da09c82ea0689.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13647ffb-bad0-5d5b-b5a0-b9d6a907b083/13647ffb-bad0-5d5b-b5a0-b9d6a907b083_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/ac/55ace7e2f3e03eae4787dbe9b80bb010/pa/GK84881_8ca20261ffeedab2b2f47498360732e3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid Dynamic+',
 'transmission': 'automatic',
 'trim': 'Dynamic+',
 'year': 2019}
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK84881%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [auto1.it] INFO: Saving data for GK84881: {'created_time': 1774861605.214628, 'last_price_update_time': 1774861605.214642, 'auction_closing_time': 1774969359.0}
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GK84881') HTTP/1.1" 204 0
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_74458c14f2f321ef628627977c23ab00.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a189435de61bbdecc38d48e20b5e112a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_6b474df09a79e849d04d13423e9a3bc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_6b474df09a79e849d04d13423e9a3bc2.jpg not downloaded yet
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_3ff8394226eea134dce287f05dfbe14a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_3ff8394226eea134dce287f05dfbe14a.jpg not downloaded yet
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_ae900fc86053399190c423a8236f0cfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_ae900fc86053399190c423a8236f0cfb.jpg not downloaded yet
2026-03-30 09:06:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee266abd0>
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_4d86e028d1a2acdd4aacb891e9e58182.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_4d86e028d1a2acdd4aacb891e9e58182.jpg saved to cache
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2536fd0>
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_ed214cefea809b152ba7ae8601ea80a0.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_ed214cefea809b152ba7ae8601ea80a0.jpg saved to cache
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0122f81b-c76c-586a-ae94-ad42aedf07ee
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_a3ef0e89b3bcf699ef8ebeae56ce1fa9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_83a0c92a920faf806194e2df2bcdf47e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_83a0c92a920faf806194e2df2bcdf47e.jpg not downloaded yet
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_befb9da4d3e259b12951c6c465349c0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_befb9da4d3e259b12951c6c465349c0b.jpg not downloaded yet
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_b635298562003ad20314bd753d640f92.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_b635298562003ad20314bd753d640f92.jpg not downloaded yet
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2808b10>
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_74458c14f2f321ef628627977c23ab00.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_74458c14f2f321ef628627977c23ab00.jpg saved to cache
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3338be66-0d2b-5217-a485-094598f98b3d
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2809910>
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_a189435de61bbdecc38d48e20b5e112a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a189435de61bbdecc38d48e20b5e112a.jpg saved to cache
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0122f81b-c76c-586a-ae94-ad42aedf07ee
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_4613a95d0f2b79b6f28b051e69078805.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_4613a95d0f2b79b6f28b051e69078805.jpg not downloaded yet
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_406178b897902524ac64b1d781d6720c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_ca0b694c28b79b809ec53303add7809b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_f47ed308e9691da702338da690442438.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_f47ed308e9691da702338da690442438.jpg not downloaded yet
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee285df50>
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024995a8-8f63-531a-bfe8-ac37bb551df1/024995a8-8f63-531a-bfe8-ac37bb551df1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F70%252Fd1702ee988dae58ba0759215ce6c2358%252Fpa%252FWY43100_a3ef0e89b3bcf699ef8ebeae56ce1fa9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_a3ef0e89b3bcf699ef8ebeae56ce1fa9.jpg saved to cache
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 024995a8-8f63-531a-bfe8-ac37bb551df1
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_adc4009447a868d9b49ca97f7267d561.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_adc4009447a868d9b49ca97f7267d561.jpg not downloaded yet
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_f7847ad4a34b1ab41e2111779b462472.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_7c3c8a89fbbd79d87fb985ed1e4b5101.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_7c3c8a89fbbd79d87fb985ed1e4b5101.jpg not downloaded yet
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24e1510>
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_406178b897902524ac64b1d781d6720c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_406178b897902524ac64b1d781d6720c.jpg saved to cache
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e58ff75c-8870-52cc-9acd-3f1303e3b574
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27fbb50>
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024995a8-8f63-531a-bfe8-ac37bb551df1/024995a8-8f63-531a-bfe8-ac37bb551df1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F70%252Fd1702ee988dae58ba0759215ce6c2358%252Fpa%252FWY43100_ca0b694c28b79b809ec53303add7809b.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_ca0b694c28b79b809ec53303add7809b.jpg saved to cache
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 024995a8-8f63-531a-bfe8-ac37bb551df1
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1277790>
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_f7847ad4a34b1ab41e2111779b462472.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_f7847ad4a34b1ab41e2111779b462472.jpg saved to cache
2026-03-30 09:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3de27fce1314ed2e375bb15c095ce453.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_9f476703a1d8016c157b50e5d7855f2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_76ff3fbb5ca375be9f847c3ca328e9b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_f2148e359f36519b815fc48b835bde32.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_64186aae62903f069d40ddd82c497cc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_d66bdd83f731844e0755a27cfdb12e7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_d1c77c69765ded013b71568629deec8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_c52ba9edd4b9ee7b99b8a6d4f7aee1a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_f47ed308e9691da702338da690442438.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_0ee5970153b3569fb40787bca9c6195e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_b635298562003ad20314bd753d640f92.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12c3110>
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F26%252F80264837a00f90ce6d9a945c3d694b93%252Fpa%252FJL77686_3de27fce1314ed2e375bb15c095ce453.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3de27fce1314ed2e375bb15c095ce453.jpg saved to cache
2026-03-30 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5887a42d-53a5-559d-a387-e5c6577c131c
2026-03-30 09:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5887a42d-53a5-559d-a387-e5c6577c131c, skipping ID generation
2026-03-30 09:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5887a42d-53a5-559d-a387-e5c6577c131c with scrape type 1
2026-03-30 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5887a42d-53a5-559d-a387-e5c6577c131c sending to next pipeline
2026-03-30 09:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5887a42d-53a5-559d-a387-e5c6577c131c, identifier: JL77686
2026-03-30 09:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5887a42d-53a5-559d-a387-e5c6577c131c with identifier: JL77686
2026-03-30 09:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5887a42d-53a5-559d-a387-e5c6577c131c with identifier: JL77686
2026-03-30 09:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5887a42d-53a5-559d-a387-e5c6577c131c with identifier: JL77686 to the API
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3de27fce1314ed2e375bb15c095ce453.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:40:47Z',
 'fuel_type': 'diesel',
 'id': '5887a42d-53a5-559d-a387-e5c6577c131c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL77686',
 'listing': 'auction',
 'location': 'IT, Modena',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 87148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469488,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3de27fce1314ed2e375bb15c095ce453.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3e5f91fc4482653853873ebcf3c93353.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_5ed9ce3181b3a38616069abb031745c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_3f1e0d3dc4bfb3e77558f79a6e7ef7fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_ea50b035a2230776dfb78ec18e55cdc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2424668,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_2818012c624c02071ec39326f6e0c6e0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_f5c9f13a37db7726df685173150dc0a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_dd02dd9e6ee7defc2d30a0c86b013f9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_1476ae1a335cac1a2a90b2836ec4d217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5887a42d-53a5-559d-a387-e5c6577c131c/5887a42d-53a5-559d-a387-e5c6577c131c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/26/80264837a00f90ce6d9a945c3d694b93/pa/JL77686_21542575ad6c8d202b99abe07c9ebc66.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid XLine 2WD',
 'transmission': 'automatic',
 'trim': 'XLine 2WD',
 'year': 2021}
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL77686%27 HTTP/1.1" 200 None
2026-03-30 09:06:46 [auto1.it] INFO: Saving data for JL77686: {'created_time': 1774861606.682195, 'last_price_update_time': 1774861606.682214, 'auction_closing_time': 1774971647.0}
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JL77686') HTTP/1.1" 204 0
2026-03-30 09:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_4613a95d0f2b79b6f28b051e69078805.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_a837985651162cc536be6820a656da70.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_7c3c8a89fbbd79d87fb985ed1e4b5101.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_adc4009447a868d9b49ca97f7267d561.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_befb9da4d3e259b12951c6c465349c0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_95465dcbccd31b04e1be94d3ffb17ebf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_ef7148f07e27bf7677a8abd28e83af37.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN45721> (referer: https://www.auto1.com/v1/car-details-view/VN45721/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24e2f10>
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_9f476703a1d8016c157b50e5d7855f2e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_9f476703a1d8016c157b50e5d7855f2e.jpg saved to cache
2026-03-30 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2824150>
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_76ff3fbb5ca375be9f847c3ca328e9b4.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_76ff3fbb5ca375be9f847c3ca328e9b4.jpg saved to cache
2026-03-30 09:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3338be66-0d2b-5217-a485-094598f98b3d
2026-03-30 09:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48c98d0>
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_f2148e359f36519b815fc48b835bde32.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_f2148e359f36519b815fc48b835bde32.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34df70c4-3a7e-5022-913d-5811e4275b13
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26054d0>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_64186aae62903f069d40ddd82c497cc4.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_64186aae62903f069d40ddd82c497cc4.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3338be66-0d2b-5217-a485-094598f98b3d
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1190410>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_d66bdd83f731844e0755a27cfdb12e7e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_d66bdd83f731844e0755a27cfdb12e7e.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3338be66-0d2b-5217-a485-094598f98b3d
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-30 09:06:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00)X\x19\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xab\x88\x00(\xee\x97\x00\x00\x00\x00'
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2759f50>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_8.mpo HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_d1c77c69765ded013b71568629deec8c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_d1c77c69765ded013b71568629deec8c.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37a65657-0884-595c-9188-1906d489adba
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48cba90>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_c52ba9edd4b9ee7b99b8a6d4f7aee1a4.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_c52ba9edd4b9ee7b99b8a6d4f7aee1a4.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1192050>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_f47ed308e9691da702338da690442438.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_f47ed308e9691da702338da690442438.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2683050>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_0ee5970153b3569fb40787bca9c6195e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_0ee5970153b3569fb40787bca9c6195e.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c9910>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_b635298562003ad20314bd753d640f92.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_b635298562003ad20314bd753d640f92.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2556690>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_4613a95d0f2b79b6f28b051e69078805.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_4613a95d0f2b79b6f28b051e69078805.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2556ad0>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_a837985651162cc536be6820a656da70.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_a837985651162cc536be6820a656da70.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12f6310>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_7c3c8a89fbbd79d87fb985ed1e4b5101.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_7c3c8a89fbbd79d87fb985ed1e4b5101.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee4ac5990>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_adc4009447a868d9b49ca97f7267d561.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_adc4009447a868d9b49ca97f7267d561.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1294e90>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_befb9da4d3e259b12951c6c465349c0b.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_befb9da4d3e259b12951c6c465349c0b.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1296f50>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_95465dcbccd31b04e1be94d3ffb17ebf.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_95465dcbccd31b04e1be94d3ffb17ebf.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0122f81b-c76c-586a-ae94-ad42aedf07ee
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12f78d0>
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_ef7148f07e27bf7677a8abd28e83af37.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_ef7148f07e27bf7677a8abd28e83af37.jpg saved to cache
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e58ff75c-8870-52cc-9acd-3f1303e3b574
2026-03-30 09:06:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d450f7c1-a363-57e7-a250-b573c0d7205b with identifier: VN45721
2026-03-30 09:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d450f7c1-a363-57e7-a250-b573c0d7205b with scrape type 1
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d450f7c1-a363-57e7-a250-b573c0d7205b
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F1e%252F0a1ece58d424981a3c91bede37cf64b7%252Fpa%252FVN45721_a1062e864023baf90ff6a231441e0502.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_a1062e864023baf90ff6a231441e0502.jpg not downloaded yet
2026-03-30 09:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F1e%252F0a1ece58d424981a3c91bede37cf64b7%252Fpa%252FVN45721_131631bd22ad292ba9887c86d957f103.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_131631bd22ad292ba9887c86d957f103.jpg not downloaded yet
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F1e%252F0a1ece58d424981a3c91bede37cf64b7%252Fpa%252FVN45721_bbebc80f02e7f32f1b9934c9f5f0ad61.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_bbebc80f02e7f32f1b9934c9f5f0ad61.jpg not downloaded yet
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F1e%252F0a1ece58d424981a3c91bede37cf64b7%252Fpa%252FVN45721_66f700fd8694da9b91be6445491354a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_66f700fd8694da9b91be6445491354a7.jpg not downloaded yet
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F1e%252F0a1ece58d424981a3c91bede37cf64b7%252Fpa%252FVN45721_8c369bb3b20172052195f82b4c287b62.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_8c369bb3b20172052195f82b4c287b62.jpg not downloaded yet
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_fddc48335ae2f459dd65ad6d07c2278a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_ae900fc86053399190c423a8236f0cfb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_965f0cbdc2732762c27bef65c66801c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_83a0c92a920faf806194e2df2bcdf47e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_8e8303f6a9366032e8b0017f4620e734.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_d234972c7e7b8e8fe9cc07b6f7746e18.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a09480ced08747545bed795fd20a9d8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_ac54acb19bde72706548c0bf0ee40a3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee270ae90>
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_fddc48335ae2f459dd65ad6d07c2278a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_fddc48335ae2f459dd65ad6d07c2278a.jpg saved to cache
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee137c210>
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_ae900fc86053399190c423a8236f0cfb.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_ae900fc86053399190c423a8236f0cfb.jpg saved to cache
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_6b474df09a79e849d04d13423e9a3bc2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_5ab689dea87d8ce4ec8fe2e95570691f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_bfb8e0c6c6ff77273d1aee25d9df84cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_c86c307192bf90b50f994ae2fcb5fe78.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_3ff8394226eea134dce287f05dfbe14a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1484bd0>
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_965f0cbdc2732762c27bef65c66801c6.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_965f0cbdc2732762c27bef65c66801c6.jpg saved to cache
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee286ce90>
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_83a0c92a920faf806194e2df2bcdf47e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_83a0c92a920faf806194e2df2bcdf47e.jpg saved to cache
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e58ff75c-8870-52cc-9acd-3f1303e3b574
2026-03-30 09:06:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee283ef10>
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_8e8303f6a9366032e8b0017f4620e734.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_8e8303f6a9366032e8b0017f4620e734.jpg saved to cache
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3338be66-0d2b-5217-a485-094598f98b3d
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12f52d0>
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F91%252F8391002a2da74e081ee791a736b41d3d%252Fpa%252FYH99570_d234972c7e7b8e8fe9cc07b6f7746e18.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_d234972c7e7b8e8fe9cc07b6f7746e18.jpg saved to cache
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d
2026-03-30 09:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0981e054-2cc0-5e86-b026-e3bcbe4ee41d, skipping ID generation
2026-03-30 09:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d with scrape type 1
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0981e054-2cc0-5e86-b026-e3bcbe4ee41d sending to next pipeline
2026-03-30 09:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0981e054-2cc0-5e86-b026-e3bcbe4ee41d, identifier: YH99570
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48c55d0>
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_a09480ced08747545bed795fd20a9d8f.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a09480ced08747545bed795fd20a9d8f.jpg saved to cache
2026-03-30 09:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0122f81b-c76c-586a-ae94-ad42aedf07ee
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48cbf50>
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_ac54acb19bde72706548c0bf0ee40a3c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_ac54acb19bde72706548c0bf0ee40a3c.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e58ff75c-8870-52cc-9acd-3f1303e3b574
2026-03-30 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_a1062e864023baf90ff6a231441e0502.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_66f700fd8694da9b91be6445491354a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0981e054-2cc0-5e86-b026-e3bcbe4ee41d with identifier: YH99570
2026-03-30 09:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0981e054-2cc0-5e86-b026-e3bcbe4ee41d with identifier: YH99570
2026-03-30 09:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0981e054-2cc0-5e86-b026-e3bcbe4ee41d with identifier: YH99570 to the API
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_d234972c7e7b8e8fe9cc07b6f7746e18.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'category': 'Taxi',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:06:14Z',
 'fuel_type': 'hybrid',
 'id': '0981e054-2cc0-5e86-b026-e3bcbe4ee41d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH99570',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 141846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_d234972c7e7b8e8fe9cc07b6f7746e18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_9f476703a1d8016c157b50e5d7855f2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_fddc48335ae2f459dd65ad6d07c2278a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_a837985651162cc536be6820a656da70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_ae900fc86053399190c423a8236f0cfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_b635298562003ad20314bd753d640f92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_4613a95d0f2b79b6f28b051e69078805.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_f47ed308e9691da702338da690442438.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_adc4009447a868d9b49ca97f7267d561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0981e054-2cc0-5e86-b026-e3bcbe4ee41d/0981e054-2cc0-5e86-b026-e3bcbe4ee41d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/91/8391002a2da74e081ee791a736b41d3d/pa/YH99570_7c3c8a89fbbd79d87fb985ed1e4b5101.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2016}
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH99570%27 HTTP/1.1" 200 None
2026-03-30 09:06:49 [auto1.it] INFO: Saving data for YH99570: {'created_time': 1774861609.376913, 'last_price_update_time': 1774861609.376928, 'auction_closing_time': 1774969574.0}
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH99570') HTTP/1.1" 204 0
2026-03-30 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_8c369bb3b20172052195f82b4c287b62.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_1ea3d83e9f5e002ae5849251f7f21f4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_e14bab2d77866ace6eef5b4529f89b2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_131631bd22ad292ba9887c86d957f103.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_bbebc80f02e7f32f1b9934c9f5f0ad61.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2603110>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_6b474df09a79e849d04d13423e9a3bc2.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_6b474df09a79e849d04d13423e9a3bc2.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e58ff75c-8870-52cc-9acd-3f1303e3b574
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11b8f50>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_5ab689dea87d8ce4ec8fe2e95570691f.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_5ab689dea87d8ce4ec8fe2e95570691f.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0122f81b-c76c-586a-ae94-ad42aedf07ee
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26a9350>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_bfb8e0c6c6ff77273d1aee25d9df84cf.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_bfb8e0c6c6ff77273d1aee25d9df84cf.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e58ff75c-8870-52cc-9acd-3f1303e3b574
2026-03-30 09:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1475b90>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_c86c307192bf90b50f994ae2fcb5fe78.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_c86c307192bf90b50f994ae2fcb5fe78.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26a9350>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_3ff8394226eea134dce287f05dfbe14a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_3ff8394226eea134dce287f05dfbe14a.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee4ed9f90>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d450f7c1-a363-57e7-a250-b573c0d7205b/d450f7c1-a363-57e7-a250-b573c0d7205b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F1e%252F0a1ece58d424981a3c91bede37cf64b7%252Fpa%252FVN45721_a1062e864023baf90ff6a231441e0502.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_a1062e864023baf90ff6a231441e0502.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d450f7c1-a363-57e7-a250-b573c0d7205b
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1432410>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d450f7c1-a363-57e7-a250-b573c0d7205b/d450f7c1-a363-57e7-a250-b573c0d7205b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F1e%252F0a1ece58d424981a3c91bede37cf64b7%252Fpa%252FVN45721_66f700fd8694da9b91be6445491354a7.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_66f700fd8694da9b91be6445491354a7.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d450f7c1-a363-57e7-a250-b573c0d7205b
2026-03-30 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_eb2f4a9fa0700be0a4694b2984eab5dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_4496f099e336f2e75d653f1da20c1f02.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13bb510>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d450f7c1-a363-57e7-a250-b573c0d7205b/d450f7c1-a363-57e7-a250-b573c0d7205b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F1e%252F0a1ece58d424981a3c91bede37cf64b7%252Fpa%252FVN45721_8c369bb3b20172052195f82b4c287b62.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_8c369bb3b20172052195f82b4c287b62.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d450f7c1-a363-57e7-a250-b573c0d7205b
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12f7a50>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024995a8-8f63-531a-bfe8-ac37bb551df1/024995a8-8f63-531a-bfe8-ac37bb551df1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F70%252Fd1702ee988dae58ba0759215ce6c2358%252Fpa%252FWY43100_1ea3d83e9f5e002ae5849251f7f21f4a.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_1ea3d83e9f5e002ae5849251f7f21f4a.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 024995a8-8f63-531a-bfe8-ac37bb551df1
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee28496d0>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_e14bab2d77866ace6eef5b4529f89b2b.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_e14bab2d77866ace6eef5b4529f89b2b.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e58ff75c-8870-52cc-9acd-3f1303e3b574
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee121b8d0>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d450f7c1-a363-57e7-a250-b573c0d7205b/d450f7c1-a363-57e7-a250-b573c0d7205b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F1e%252F0a1ece58d424981a3c91bede37cf64b7%252Fpa%252FVN45721_131631bd22ad292ba9887c86d957f103.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_131631bd22ad292ba9887c86d957f103.jpg saved to cache
2026-03-30 09:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d450f7c1-a363-57e7-a250-b573c0d7205b
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26054d0>
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d450f7c1-a363-57e7-a250-b573c0d7205b/d450f7c1-a363-57e7-a250-b573c0d7205b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F1e%252F0a1ece58d424981a3c91bede37cf64b7%252Fpa%252FVN45721_bbebc80f02e7f32f1b9934c9f5f0ad61.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_bbebc80f02e7f32f1b9934c9f5f0ad61.jpg saved to cache
2026-03-30 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d450f7c1-a363-57e7-a250-b573c0d7205b
2026-03-30 09:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d450f7c1-a363-57e7-a250-b573c0d7205b, skipping ID generation
2026-03-30 09:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d450f7c1-a363-57e7-a250-b573c0d7205b with scrape type 1
2026-03-30 09:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d450f7c1-a363-57e7-a250-b573c0d7205b sending to next pipeline
2026-03-30 09:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d450f7c1-a363-57e7-a250-b573c0d7205b, identifier: VN45721
2026-03-30 09:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d450f7c1-a363-57e7-a250-b573c0d7205b with identifier: VN45721
2026-03-30 09:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d450f7c1-a363-57e7-a250-b573c0d7205b with identifier: VN45721
2026-03-30 09:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d450f7c1-a363-57e7-a250-b573c0d7205b with identifier: VN45721 to the API
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_bbebc80f02e7f32f1b9934c9f5f0ad61.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:12:01Z',
 'fuel_type': 'petrol',
 'id': 'd450f7c1-a363-57e7-a250-b573c0d7205b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN45721',
 'listing': 'auction',
 'location': 'IT, Santo Stefano di Magra SP',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 154110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d450f7c1-a363-57e7-a250-b573c0d7205b/d450f7c1-a363-57e7-a250-b573c0d7205b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_a1062e864023baf90ff6a231441e0502.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d450f7c1-a363-57e7-a250-b573c0d7205b/d450f7c1-a363-57e7-a250-b573c0d7205b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_131631bd22ad292ba9887c86d957f103.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d450f7c1-a363-57e7-a250-b573c0d7205b/d450f7c1-a363-57e7-a250-b573c0d7205b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_bbebc80f02e7f32f1b9934c9f5f0ad61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d450f7c1-a363-57e7-a250-b573c0d7205b/d450f7c1-a363-57e7-a250-b573c0d7205b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_66f700fd8694da9b91be6445491354a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d450f7c1-a363-57e7-a250-b573c0d7205b/d450f7c1-a363-57e7-a250-b573c0d7205b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/1e/0a1ece58d424981a3c91bede37cf64b7/pa/VN45721_8c369bb3b20172052195f82b4c287b62.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-11-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Nissan Micra 1.6 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2006}
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN45721%27 HTTP/1.1" 200 None
2026-03-30 09:06:51 [auto1.it] INFO: Saving data for VN45721: {'created_time': 1774861611.068322, 'last_price_update_time': 1774861611.068338, 'auction_closing_time': 1774969921.0}
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VN45721') HTTP/1.1" 204 0
2026-03-30 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_36028c7dd7f9e28dde5ae99d6ec76a3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_eb3fcd1257b938a85bb713b8c38106c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_12a929256f9754b8814e34dc165ec8fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_d9db616b463d4c0f3fdc4f12534d565e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP59254> (referer: https://www.auto1.com/v1/car-details-view/EP59254/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA01979> (referer: https://www.auto1.com/v1/car-details-view/YA01979/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27fcd10>
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_eb2f4a9fa0700be0a4694b2984eab5dd.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_eb2f4a9fa0700be0a4694b2984eab5dd.jpg saved to cache
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0122f81b-c76c-586a-ae94-ad42aedf07ee
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1376410>
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024995a8-8f63-531a-bfe8-ac37bb551df1/024995a8-8f63-531a-bfe8-ac37bb551df1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F70%252Fd1702ee988dae58ba0759215ce6c2358%252Fpa%252FWY43100_4496f099e336f2e75d653f1da20c1f02.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_4496f099e336f2e75d653f1da20c1f02.jpg saved to cache
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 024995a8-8f63-531a-bfe8-ac37bb551df1
2026-03-30 09:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 024995a8-8f63-531a-bfe8-ac37bb551df1, skipping ID generation
2026-03-30 09:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 024995a8-8f63-531a-bfe8-ac37bb551df1 with scrape type 1
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 024995a8-8f63-531a-bfe8-ac37bb551df1 sending to next pipeline
2026-03-30 09:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 024995a8-8f63-531a-bfe8-ac37bb551df1, identifier: WY43100
2026-03-30 09:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 024995a8-8f63-531a-bfe8-ac37bb551df1 with identifier: WY43100
2026-03-30 09:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 024995a8-8f63-531a-bfe8-ac37bb551df1 with identifier: WY43100
2026-03-30 09:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 024995a8-8f63-531a-bfe8-ac37bb551df1 with identifier: WY43100 to the API
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_4496f099e336f2e75d653f1da20c1f02.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 250,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.5L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:40:06Z',
 'fuel_type': 'diesel',
 'id': '024995a8-8f63-531a-bfe8-ac37bb551df1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY43100',
 'listing': 'auction',
 'location': 'IT, Piacenza',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 172681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024995a8-8f63-531a-bfe8-ac37bb551df1/024995a8-8f63-531a-bfe8-ac37bb551df1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_a556582bba6ac769c8a8441e9e7044a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024995a8-8f63-531a-bfe8-ac37bb551df1/024995a8-8f63-531a-bfe8-ac37bb551df1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_a3ef0e89b3bcf699ef8ebeae56ce1fa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024995a8-8f63-531a-bfe8-ac37bb551df1/024995a8-8f63-531a-bfe8-ac37bb551df1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_4496f099e336f2e75d653f1da20c1f02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024995a8-8f63-531a-bfe8-ac37bb551df1/024995a8-8f63-531a-bfe8-ac37bb551df1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_ca0b694c28b79b809ec53303add7809b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024995a8-8f63-531a-bfe8-ac37bb551df1/024995a8-8f63-531a-bfe8-ac37bb551df1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/70/d1702ee988dae58ba0759215ce6c2358/pa/WY43100_1ea3d83e9f5e002ae5849251f7f21f4a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Cherokee 2.5 CRD Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2004}
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY43100%27 HTTP/1.1" 200 None
2026-03-30 09:06:51 [auto1.it] INFO: Saving data for WY43100: {'created_time': 1774861611.742767, 'last_price_update_time': 1774861611.742782, 'auction_closing_time': 1774971606.0}
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WY43100') HTTP/1.1" 204 0
2026-03-30 09:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_8af26d2ccb7dcc76d63702ac6c2a88c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27ffb50>
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_36028c7dd7f9e28dde5ae99d6ec76a3f.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_36028c7dd7f9e28dde5ae99d6ec76a3f.jpg saved to cache
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e58ff75c-8870-52cc-9acd-3f1303e3b574
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25dbd50>
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_eb3fcd1257b938a85bb713b8c38106c5.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_eb3fcd1257b938a85bb713b8c38106c5.jpg saved to cache
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0122f81b-c76c-586a-ae94-ad42aedf07ee
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1297690>
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_12a929256f9754b8814e34dc165ec8fd.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_12a929256f9754b8814e34dc165ec8fd.jpg saved to cache
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0122f81b-c76c-586a-ae94-ad42aedf07ee
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25db910>
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fe3%252Fb2e3dacd28bbd7f58b28175a1a1178e4%252Fpa%252FJP33572_d9db616b463d4c0f3fdc4f12534d565e.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_d9db616b463d4c0f3fdc4f12534d565e.jpg saved to cache
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20
2026-03-30 09:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bf85059-ce24-510e-8b4a-0cf19aa11c20, skipping ID generation
2026-03-30 09:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20 with scrape type 1
2026-03-30 09:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bf85059-ce24-510e-8b4a-0cf19aa11c20 sending to next pipeline
2026-03-30 09:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8bf85059-ce24-510e-8b4a-0cf19aa11c20, identifier: JP33572
2026-03-30 09:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 280c1775-e1ff-5fe8-8903-4139b7271733 with identifier: EP59254
2026-03-30 09:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 280c1775-e1ff-5fe8-8903-4139b7271733 with scrape type 1
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 280c1775-e1ff-5fe8-8903-4139b7271733
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7a%252Fad7a87a3278e7e5b6b3bdd5a08920924%252Fpa%252FEP59254_ce656583d822aac088d70f81feb4487d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_ce656583d822aac088d70f81feb4487d.jpg already downloaded
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7a%252Fad7a87a3278e7e5b6b3bdd5a08920924%252Fpa%252FEP59254_e998eeb5e9f8c8728c54e937e14f243e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_e998eeb5e9f8c8728c54e937e14f243e.jpg already downloaded
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7a%252Fad7a87a3278e7e5b6b3bdd5a08920924%252Fpa%252FEP59254_5e74b3544d78bd0415c1ebdd1dda7f87.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_5e74b3544d78bd0415c1ebdd1dda7f87.jpg already downloaded
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7a%252Fad7a87a3278e7e5b6b3bdd5a08920924%252Fpa%252FEP59254_975867bcb6c5270837ec9d76c03e50da.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_975867bcb6c5270837ec9d76c03e50da.jpg already downloaded
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7a%252Fad7a87a3278e7e5b6b3bdd5a08920924%252Fpa%252FEP59254_4bd3b5d24b8c21f2db5d07a8a76a0708.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_4bd3b5d24b8c21f2db5d07a8a76a0708.jpg already downloaded
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7a%252Fad7a87a3278e7e5b6b3bdd5a08920924%252Fpa%252FEP59254_2b06d7b195ce99d28f787c8cca210533.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_2b06d7b195ce99d28f787c8cca210533.jpg already downloaded
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7a%252Fad7a87a3278e7e5b6b3bdd5a08920924%252Fpa%252FEP59254_252a0a6ea2a94e435e95f5518602e582.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_252a0a6ea2a94e435e95f5518602e582.jpg already downloaded
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7a%252Fad7a87a3278e7e5b6b3bdd5a08920924%252Fpa%252FEP59254_23acffc8d6739e2e65ee349d62e2d177.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_23acffc8d6739e2e65ee349d62e2d177.jpg already downloaded
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7a%252Fad7a87a3278e7e5b6b3bdd5a08920924%252Fpa%252FEP59254_0afecdd6b619d496fa2ba94292c763a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_0afecdd6b619d496fa2ba94292c763a8.jpg already downloaded
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7a%252Fad7a87a3278e7e5b6b3bdd5a08920924%252Fpa%252FEP59254_6382594b1afdc9e5de40f14c768dba21.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_6382594b1afdc9e5de40f14c768dba21.jpg already downloaded
2026-03-30 09:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 280c1775-e1ff-5fe8-8903-4139b7271733, identifier: EP59254
2026-03-30 09:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7faf0559-bf9b-5089-875e-1f82f4519949 with identifier: YA01979
2026-03-30 09:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7faf0559-bf9b-5089-875e-1f82f4519949 with scrape type 1
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7faf0559-bf9b-5089-875e-1f82f4519949
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_34a80cf7462eab56566b4890c51b2551.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_34a80cf7462eab56566b4890c51b2551.jpg not downloaded yet
2026-03-30 09:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a7bec62c3407657984f47ab1ec6d46ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_76486e9244de2444eb04011170af6fe0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8bf85059-ce24-510e-8b4a-0cf19aa11c20 with identifier: JP33572
2026-03-30 09:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8bf85059-ce24-510e-8b4a-0cf19aa11c20 with identifier: JP33572
2026-03-30 09:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8bf85059-ce24-510e-8b4a-0cf19aa11c20 with identifier: JP33572 to the API
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_d9db616b463d4c0f3fdc4f12534d565e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:25:51Z',
 'fuel_type': 'diesel',
 'id': '8bf85059-ce24-510e-8b4a-0cf19aa11c20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP33572',
 'listing': 'auction',
 'location': 'IT, Cuneo',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 116872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_1db6f612c8d8bd95e3939970f1402396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_4d86e028d1a2acdd4aacb891e9e58182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_d9db616b463d4c0f3fdc4f12534d565e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_f7847ad4a34b1ab41e2111779b462472.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_c86c307192bf90b50f994ae2fcb5fe78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_c52ba9edd4b9ee7b99b8a6d4f7aee1a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_965f0cbdc2732762c27bef65c66801c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_0ee5970153b3569fb40787bca9c6195e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_3ff8394226eea134dce287f05dfbe14a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf85059-ce24-510e-8b4a-0cf19aa11c20/8bf85059-ce24-510e-8b4a-0cf19aa11c20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/e3/b2e3dacd28bbd7f58b28175a1a1178e4/pa/JP33572_befb9da4d3e259b12951c6c465349c0b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2017}
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP33572%27 HTTP/1.1" 200 None
2026-03-30 09:06:52 [auto1.it] INFO: Saving data for JP33572: {'created_time': 1774861612.910376, 'last_price_update_time': 1774861612.910389, 'auction_closing_time': 1774970751.0}
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP33572') HTTP/1.1" 204 0
2026-03-30 09:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 280c1775-e1ff-5fe8-8903-4139b7271733 with identifier: EP59254
2026-03-30 09:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 09:06:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 280c1775-e1ff-5fe8-8903-4139b7271733 with identifier: EP59254
2026-03-30 09:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 280c1775-e1ff-5fe8-8903-4139b7271733 with identifier: EP59254 to the API
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EP59254>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:15:16Z',
 'fuel_type': 'petrol',
 'id': '280c1775-e1ff-5fe8-8903-4139b7271733',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP59254',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 160401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_ce656583d822aac088d70f81feb4487d.jpg',
                'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_e998eeb5e9f8c8728c54e937e14f243e.jpg',
                'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_5e74b3544d78bd0415c1ebdd1dda7f87.jpg',
                'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_975867bcb6c5270837ec9d76c03e50da.jpg',
                'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_4bd3b5d24b8c21f2db5d07a8a76a0708.jpg',
                'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_2b06d7b195ce99d28f787c8cca210533.jpg',
                'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_252a0a6ea2a94e435e95f5518602e582.jpg',
                'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_23acffc8d6739e2e65ee349d62e2d177.jpg',
                'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_0afecdd6b619d496fa2ba94292c763a8.jpg',
                'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_6382594b1afdc9e5de40f14c768dba21.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280c1775-e1ff-5fe8-8903-4139b7271733/280c1775-e1ff-5fe8-8903-4139b7271733_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_ce656583d822aac088d70f81feb4487d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280c1775-e1ff-5fe8-8903-4139b7271733/280c1775-e1ff-5fe8-8903-4139b7271733_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_e998eeb5e9f8c8728c54e937e14f243e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280c1775-e1ff-5fe8-8903-4139b7271733/280c1775-e1ff-5fe8-8903-4139b7271733_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_5e74b3544d78bd0415c1ebdd1dda7f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280c1775-e1ff-5fe8-8903-4139b7271733/280c1775-e1ff-5fe8-8903-4139b7271733_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_975867bcb6c5270837ec9d76c03e50da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280c1775-e1ff-5fe8-8903-4139b7271733/280c1775-e1ff-5fe8-8903-4139b7271733_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_4bd3b5d24b8c21f2db5d07a8a76a0708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280c1775-e1ff-5fe8-8903-4139b7271733/280c1775-e1ff-5fe8-8903-4139b7271733_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_2b06d7b195ce99d28f787c8cca210533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280c1775-e1ff-5fe8-8903-4139b7271733/280c1775-e1ff-5fe8-8903-4139b7271733_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_252a0a6ea2a94e435e95f5518602e582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280c1775-e1ff-5fe8-8903-4139b7271733/280c1775-e1ff-5fe8-8903-4139b7271733_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_23acffc8d6739e2e65ee349d62e2d177.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280c1775-e1ff-5fe8-8903-4139b7271733/280c1775-e1ff-5fe8-8903-4139b7271733_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_0afecdd6b619d496fa2ba94292c763a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_280c1775-e1ff-5fe8-8903-4139b7271733/280c1775-e1ff-5fe8-8903-4139b7271733_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7a/ad7a87a3278e7e5b6b3bdd5a08920924/pa/EP59254_6382594b1afdc9e5de40f14c768dba21.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2015}
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP59254%27 HTTP/1.1" 200 None
2026-03-30 09:06:53 [auto1.it] INFO: Saving data for EP59254: {'created_time': 1774861613.453123, 'last_price_update_time': 1774861613.453136, 'auction_closing_time': 1774970116.0}
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EP59254') HTTP/1.1" 204 0
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_9f1e396697557ead28da0f07b8b91437.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_9f1e396697557ead28da0f07b8b91437.jpg not downloaded yet
2026-03-30 09:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU77686> (referer: https://www.auto1.com/v1/car-details-view/JU77686/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_b8078f86875b389be80112bec7120c07.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_b8078f86875b389be80112bec7120c07.jpg not downloaded yet
2026-03-30 09:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_b5f9c7994aeaa1f00ed4c548278bfc0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee4df5b10>
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_8af26d2ccb7dcc76d63702ac6c2a88c7.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_8af26d2ccb7dcc76d63702ac6c2a88c7.jpg saved to cache
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1098a10>
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Ff5%252Febf57500fcd7cac7a1451ff71edea6e2%252Fpa%252FJA46971_a7bec62c3407657984f47ab1ec6d46ef.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a7bec62c3407657984f47ab1ec6d46ef.jpg saved to cache
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0122f81b-c76c-586a-ae94-ad42aedf07ee
2026-03-30 09:06:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0122f81b-c76c-586a-ae94-ad42aedf07ee, skipping ID generation
2026-03-30 09:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0122f81b-c76c-586a-ae94-ad42aedf07ee with scrape type 1
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0122f81b-c76c-586a-ae94-ad42aedf07ee sending to next pipeline
2026-03-30 09:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0122f81b-c76c-586a-ae94-ad42aedf07ee, identifier: JA46971
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee283c950>
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_76486e9244de2444eb04011170af6fe0.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_76486e9244de2444eb04011170af6fe0.jpg saved to cache
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c82e4378-9bce-5734-95c1-38ad22eef594
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_abf475999ac91ccdb817e0af26669087.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_abf475999ac91ccdb817e0af26669087.jpg not downloaded yet
2026-03-30 09:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0122f81b-c76c-586a-ae94-ad42aedf07ee with identifier: JA46971
2026-03-30 09:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0122f81b-c76c-586a-ae94-ad42aedf07ee with identifier: JA46971
2026-03-30 09:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0122f81b-c76c-586a-ae94-ad42aedf07ee with identifier: JA46971 to the API
2026-03-30 09:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a7bec62c3407657984f47ab1ec6d46ef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:04:54Z',
 'fuel_type': 'diesel',
 'id': '0122f81b-c76c-586a-ae94-ad42aedf07ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA46971',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 90040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_99c6a201dc67363d989a86be39dfabf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a7bec62c3407657984f47ab1ec6d46ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_12a929256f9754b8814e34dc165ec8fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_eb3fcd1257b938a85bb713b8c38106c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_ed214cefea809b152ba7ae8601ea80a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_eb2f4a9fa0700be0a4694b2984eab5dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a189435de61bbdecc38d48e20b5e112a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_95465dcbccd31b04e1be94d3ffb17ebf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_5ab689dea87d8ce4ec8fe2e95570691f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0122f81b-c76c-586a-ae94-ad42aedf07ee/0122f81b-c76c-586a-ae94-ad42aedf07ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/f5/ebf57500fcd7cac7a1451ff71edea6e2/pa/JA46971_a09480ced08747545bed795fd20a9d8f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA46971%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [auto1.it] INFO: Saving data for JA46971: {'created_time': 1774861614.244719, 'last_price_update_time': 1774861614.24473, 'auction_closing_time': 1774969494.0}
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JA46971') HTTP/1.1" 204 0
2026-03-30 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_97f17902b5c8f568b5755580e587fcb4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_62b09e8fd4518d688b575458d35ab473.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_031015c6a962908fc57d98f1eb916920.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_5a3b5829656f054fd4906b174bb70b19.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_5a3b5829656f054fd4906b174bb70b19.jpg not downloaded yet
2026-03-30 09:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_2f74f4bf30488d69042cfb6ee4436f8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_2f74f4bf30488d69042cfb6ee4436f8c.jpg not downloaded yet
2026-03-30 09:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e050c4-721d-58a3-abd4-acdc3dd408a9 with identifier: JU77686
2026-03-30 09:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e050c4-721d-58a3-abd4-acdc3dd408a9 with scrape type 1
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27e050c4-721d-58a3-abd4-acdc3dd408a9
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_2d3116565364632876744d3f3e4da726.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_2d3116565364632876744d3f3e4da726.jpg not downloaded yet
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1099650>
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_b5f9c7994aeaa1f00ed4c548278bfc0d.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_b5f9c7994aeaa1f00ed4c548278bfc0d.jpg saved to cache
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37a65657-0884-595c-9188-1906d489adba
2026-03-30 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ19465> (referer: https://www.auto1.com/v1/car-details-view/MZ19465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_a91adf740c01a26a0ce6d9b730aaec4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_a91adf740c01a26a0ce6d9b730aaec4c.jpg not downloaded yet
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_fac9ce52f00684d38d6ae76f2420c756.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_fac9ce52f00684d38d6ae76f2420c756.jpg not downloaded yet
2026-03-30 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_34a80cf7462eab56566b4890c51b2551.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW52092> (referer: https://www.auto1.com/v1/car-details-view/BW52092/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_58ccc6405ada0ef878842ef3ba96f2f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_58ccc6405ada0ef878842ef3ba96f2f6.jpg not downloaded yet
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_20e0497e795820b6013957959d30408d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_20e0497e795820b6013957959d30408d.jpg not downloaded yet
2026-03-30 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_7ffc7f984783bf2786491b99ba32fe87.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee111aa50>
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_97f17902b5c8f568b5755580e587fcb4.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_97f17902b5c8f568b5755580e587fcb4.jpg saved to cache
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d628d6c2-6eee-5ba7-bf02-527049a3c587
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1271890>
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F22%252Fd22280e157548205e86b8344c6fcd3dc%252Fpa%252FKA76603_62b09e8fd4518d688b575458d35ab473.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_62b09e8fd4518d688b575458d35ab473.jpg saved to cache
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c82e4378-9bce-5734-95c1-38ad22eef594
2026-03-30 09:06:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c82e4378-9bce-5734-95c1-38ad22eef594, skipping ID generation
2026-03-30 09:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82e4378-9bce-5734-95c1-38ad22eef594 with scrape type 1
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c82e4378-9bce-5734-95c1-38ad22eef594 sending to next pipeline
2026-03-30 09:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c82e4378-9bce-5734-95c1-38ad22eef594, identifier: KA76603
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee109dd50>
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_031015c6a962908fc57d98f1eb916920.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_031015c6a962908fc57d98f1eb916920.jpg saved to cache
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c
2026-03-30 09:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_4e4acb1b71726a7aa5b99a566feca3d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_738246a6e6d7fd47aea9b6d627ec5352.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_738246a6e6d7fd47aea9b6d627ec5352.jpg not downloaded yet
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_f78871261742743a0af1229f79e62093.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_f78871261742743a0af1229f79e62093.jpg not downloaded yet
2026-03-30 09:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c82e4378-9bce-5734-95c1-38ad22eef594 with identifier: KA76603
2026-03-30 09:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c82e4378-9bce-5734-95c1-38ad22eef594 with identifier: KA76603
2026-03-30 09:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c82e4378-9bce-5734-95c1-38ad22eef594 with identifier: KA76603 to the API
2026-03-30 09:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_62b09e8fd4518d688b575458d35ab473.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:49:29Z',
 'fuel_type': 'diesel',
 'id': 'c82e4378-9bce-5734-95c1-38ad22eef594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA76603',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 161796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_6181549919837afe1dd4b6a6313170bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_35e9a16392155da5be5848b9ef01b65d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2189136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_f6f38ed2d2c4d860cc98f220acbca7b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1954699,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_054d262c359b601d2ca102ba63bfe7f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_373f1d1fcf0d10eb7cb68a4c1a21598c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_baca92335db858ef1c487bea77104725.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_62b09e8fd4518d688b575458d35ab473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_76486e9244de2444eb04011170af6fe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_c3fff2a881913fdeb00f40acd7a721c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82e4378-9bce-5734-95c1-38ad22eef594/c82e4378-9bce-5734-95c1-38ad22eef594_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2184653,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/22/d22280e157548205e86b8344c6fcd3dc/pa/KA76603_dbd4cc8bc06c0c826556b589e03dda6c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2018}
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA76603%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [auto1.it] INFO: Saving data for KA76603: {'created_time': 1774861615.305564, 'last_price_update_time': 1774861615.305575, 'auction_closing_time': 1774972169.0}
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KA76603') HTTP/1.1" 204 0
2026-03-30 09:06:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa08c143-7fe0-527b-ac6a-fcb3be1e10e9 with identifier: MZ19465
2026-03-30 09:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9 with scrape type 1
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_fa17bd822d9582b364b5dbc7445ec489.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_fa17bd822d9582b364b5dbc7445ec489.jpg not downloaded yet
2026-03-30 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_2cc51f2c2517f84357891c71e62db368.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_9f1e396697557ead28da0f07b8b91437.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_745072b7cd3ad88229b8354c59d95791.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_745072b7cd3ad88229b8354c59d95791.jpg not downloaded yet
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_982c88dcb8b22e870a697dd0658df83f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_982c88dcb8b22e870a697dd0658df83f.jpg not downloaded yet
2026-03-30 09:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_74c469f522f7a5d4ad5e5eb13c33d0a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_2a17847e4ab5b9036417596c3f1aa736.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_2a17847e4ab5b9036417596c3f1aa736.jpg not downloaded yet
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_3b2eacca14c99d257754e1ee3fbcc264.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_3b2eacca14c99d257754e1ee3fbcc264.jpg not downloaded yet
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee109c910>
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_34a80cf7462eab56566b4890c51b2551.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_34a80cf7462eab56566b4890c51b2551.jpg saved to cache
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7faf0559-bf9b-5089-875e-1f82f4519949
2026-03-30 09:06:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c467a7e-f86c-5adb-8e58-87167ba216e6 with identifier: BW52092
2026-03-30 09:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c467a7e-f86c-5adb-8e58-87167ba216e6 with scrape type 1
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c467a7e-f86c-5adb-8e58-87167ba216e6
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F91%252F1091309c3eae074ffc59606f98a89a50%252Fpa%252FBW52092_2ea7a2a54b01c8f1af488e7e57bd8ea2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_2ea7a2a54b01c8f1af488e7e57bd8ea2.jpg already downloaded
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F91%252F1091309c3eae074ffc59606f98a89a50%252Fpa%252FBW52092_fb48fe0573f8dc5272c4efb28b64f4a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_fb48fe0573f8dc5272c4efb28b64f4a3.jpg already downloaded
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F91%252F1091309c3eae074ffc59606f98a89a50%252Fpa%252FBW52092_ff2940d359356954eef4fdf1069087fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_ff2940d359356954eef4fdf1069087fc.jpg already downloaded
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F91%252F1091309c3eae074ffc59606f98a89a50%252Fpa%252FBW52092_df072a223e040ba671e0bc3ffd08767f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_df072a223e040ba671e0bc3ffd08767f.jpg already downloaded
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F91%252F1091309c3eae074ffc59606f98a89a50%252Fpa%252FBW52092_6ddab36bb2787af048ad96d5c08193ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_6ddab36bb2787af048ad96d5c08193ef.jpg already downloaded
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F91%252F1091309c3eae074ffc59606f98a89a50%252Fpa%252FBW52092_25c7b3b1589b0e8f566a9a24d3c5b4ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_25c7b3b1589b0e8f566a9a24d3c5b4ad.jpg already downloaded
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F91%252F1091309c3eae074ffc59606f98a89a50%252Fpa%252FBW52092_1617108fcb5b631573c36f1ead903365.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_1617108fcb5b631573c36f1ead903365.jpg already downloaded
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F91%252F1091309c3eae074ffc59606f98a89a50%252Fpa%252FBW52092_87b332052609ceab8156baa073e68d1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_87b332052609ceab8156baa073e68d1e.jpg already downloaded
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F91%252F1091309c3eae074ffc59606f98a89a50%252Fpa%252FBW52092_2d50fcad376373ace6cae16ea425a0fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_2d50fcad376373ace6cae16ea425a0fc.jpg already downloaded
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F91%252F1091309c3eae074ffc59606f98a89a50%252Fpa%252FBW52092_a16509aaf655c89af4e5bb5ae4a6af63.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_a16509aaf655c89af4e5bb5ae4a6af63.jpg already downloaded
2026-03-30 09:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1c467a7e-f86c-5adb-8e58-87167ba216e6, identifier: BW52092
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee283e8d0>
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_7ffc7f984783bf2786491b99ba32fe87.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_7ffc7f984783bf2786491b99ba32fe87.jpg saved to cache
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37a65657-0884-595c-9188-1906d489adba
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee260c390>
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_4e4acb1b71726a7aa5b99a566feca3d9.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_4e4acb1b71726a7aa5b99a566feca3d9.jpg saved to cache
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d628d6c2-6eee-5ba7-bf02-527049a3c587
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_d5a6f994362b452b5ca2b94e31e256d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_d5a6f994362b452b5ca2b94e31e256d0.jpg not downloaded yet
2026-03-30 09:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1c467a7e-f86c-5adb-8e58-87167ba216e6 with identifier: BW52092
2026-03-30 09:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1c467a7e-f86c-5adb-8e58-87167ba216e6 with identifier: BW52092
2026-03-30 09:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1c467a7e-f86c-5adb-8e58-87167ba216e6 with identifier: BW52092 to the API
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW52092>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:39:11Z',
 'fuel_type': 'petrol',
 'id': '1c467a7e-f86c-5adb-8e58-87167ba216e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW52092',
 'listing': 'auction',
 'location': 'IT, Verona (VR)',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 203532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_2ea7a2a54b01c8f1af488e7e57bd8ea2.jpg',
                'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_fb48fe0573f8dc5272c4efb28b64f4a3.jpg',
                'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_ff2940d359356954eef4fdf1069087fc.jpg',
                'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_df072a223e040ba671e0bc3ffd08767f.jpg',
                'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_6ddab36bb2787af048ad96d5c08193ef.jpg',
                'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_25c7b3b1589b0e8f566a9a24d3c5b4ad.jpg',
                'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_1617108fcb5b631573c36f1ead903365.jpg',
                'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_87b332052609ceab8156baa073e68d1e.jpg',
                'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_2d50fcad376373ace6cae16ea425a0fc.jpg',
                'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_a16509aaf655c89af4e5bb5ae4a6af63.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c467a7e-f86c-5adb-8e58-87167ba216e6/1c467a7e-f86c-5adb-8e58-87167ba216e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715911,
             'Height': 1600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_2ea7a2a54b01c8f1af488e7e57bd8ea2.jpg',
             'Width': 1143},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c467a7e-f86c-5adb-8e58-87167ba216e6/1c467a7e-f86c-5adb-8e58-87167ba216e6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_fb48fe0573f8dc5272c4efb28b64f4a3.jpg',
             'Width': 429},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c467a7e-f86c-5adb-8e58-87167ba216e6/1c467a7e-f86c-5adb-8e58-87167ba216e6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 776108,
             'Height': 1600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_ff2940d359356954eef4fdf1069087fc.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c467a7e-f86c-5adb-8e58-87167ba216e6/1c467a7e-f86c-5adb-8e58-87167ba216e6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 760875,
             'Height': 1600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_df072a223e040ba671e0bc3ffd08767f.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c467a7e-f86c-5adb-8e58-87167ba216e6/1c467a7e-f86c-5adb-8e58-87167ba216e6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 853043,
             'Height': 1600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_6ddab36bb2787af048ad96d5c08193ef.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c467a7e-f86c-5adb-8e58-87167ba216e6/1c467a7e-f86c-5adb-8e58-87167ba216e6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793002,
             'Height': 1600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_25c7b3b1589b0e8f566a9a24d3c5b4ad.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c467a7e-f86c-5adb-8e58-87167ba216e6/1c467a7e-f86c-5adb-8e58-87167ba216e6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_1617108fcb5b631573c36f1ead903365.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c467a7e-f86c-5adb-8e58-87167ba216e6/1c467a7e-f86c-5adb-8e58-87167ba216e6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 681287,
             'Height': 1600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_87b332052609ceab8156baa073e68d1e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c467a7e-f86c-5adb-8e58-87167ba216e6/1c467a7e-f86c-5adb-8e58-87167ba216e6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 499368,
             'Height': 1349,
             'OriginUrl': 'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_2d50fcad376373ace6cae16ea425a0fc.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c467a7e-f86c-5adb-8e58-87167ba216e6/1c467a7e-f86c-5adb-8e58-87167ba216e6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627020,
             'Height': 1600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/91/1091309c3eae074ffc59606f98a89a50/pa/BW52092_a16509aaf655c89af4e5bb5ae4a6af63.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2017}
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW52092%27 HTTP/1.1" 200 None
2026-03-30 09:06:56 [auto1.it] INFO: Saving data for BW52092: {'created_time': 1774861616.394574, 'last_price_update_time': 1774861616.394589, 'auction_closing_time': 1774971551.0}
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BW52092') HTTP/1.1" 204 0
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_f3f85c305f9e48f35a89b2a2a73300ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_f3f85c305f9e48f35a89b2a2a73300ff.jpg not downloaded yet
2026-03-30 09:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV38017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_2d3116565364632876744d3f3e4da726.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_b8078f86875b389be80112bec7120c07.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_abf475999ac91ccdb817e0af26669087.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_803e57242738d58975cb257de05d40d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_803e57242738d58975cb257de05d40d4.jpg not downloaded yet
2026-03-30 09:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_eaba5e67be40b703744124c251e27e47.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_2f74f4bf30488d69042cfb6ee4436f8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_e810657402b53e6a686d80d8ae9970ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_e810657402b53e6a686d80d8ae9970ce.jpg not downloaded yet
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_eeb427707c95278a9e484823d1177e4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_eeb427707c95278a9e484823d1177e4f.jpg not downloaded yet
2026-03-30 09:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10f8dd0>
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_2cc51f2c2517f84357891c71e62db368.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_2cc51f2c2517f84357891c71e62db368.jpg saved to cache
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3338be66-0d2b-5217-a485-094598f98b3d
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2825050>
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_9f1e396697557ead28da0f07b8b91437.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_9f1e396697557ead28da0f07b8b91437.jpg saved to cache
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7faf0559-bf9b-5089-875e-1f82f4519949
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee254a550>
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_74c469f522f7a5d4ad5e5eb13c33d0a1.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_74c469f522f7a5d4ad5e5eb13c33d0a1.jpg saved to cache
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_c35f37ecb8c59303bea1f00454747c0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_c35f37ecb8c59303bea1f00454747c0c.jpg not downloaded yet
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_c85ca4100c00d5cb260858ab52d62f18.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_c85ca4100c00d5cb260858ab52d62f18.jpg not downloaded yet
2026-03-30 09:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_20e0497e795820b6013957959d30408d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_a91adf740c01a26a0ce6d9b730aaec4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_fac9ce52f00684d38d6ae76f2420c756.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_306d308e1d5d938eb79b73fa7011f72e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_306d308e1d5d938eb79b73fa7011f72e.jpg not downloaded yet
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee111a690>
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_2d3116565364632876744d3f3e4da726.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_2d3116565364632876744d3f3e4da726.jpg saved to cache
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27e050c4-721d-58a3-abd4-acdc3dd408a9
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2577dd0>
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_b8078f86875b389be80112bec7120c07.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_b8078f86875b389be80112bec7120c07.jpg saved to cache
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7faf0559-bf9b-5089-875e-1f82f4519949
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11bb910>
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_abf475999ac91ccdb817e0af26669087.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_abf475999ac91ccdb817e0af26669087.jpg saved to cache
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7faf0559-bf9b-5089-875e-1f82f4519949
2026-03-30 09:06:57 [auto1.it] INFO: Channel: 24h | Page: 6 | totalHits: 3305 | hits on page: 40
2026-03-30 09:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee257d5d0>
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_eaba5e67be40b703744124c251e27e47.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_eaba5e67be40b703744124c251e27e47.jpg saved to cache
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3338be66-0d2b-5217-a485-094598f98b3d
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2669d50>
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_2f74f4bf30488d69042cfb6ee4436f8c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_2f74f4bf30488d69042cfb6ee4436f8c.jpg saved to cache
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7faf0559-bf9b-5089-875e-1f82f4519949
2026-03-30 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_f78871261742743a0af1229f79e62093.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_31e426646110033344cf53b457995b8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_31e426646110033344cf53b457995b8d.jpg not downloaded yet
2026-03-30 09:06:57 [auto1.it] INFO: Found listing with ID: RJ74890
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ74890%27 HTTP/1.1" 200 None
2026-03-30 09:06:57 [auto1.it] INFO: Scrape type for RJ74890: 1
2026-03-30 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_69fe09db54be6479a135e8e797680580.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_738246a6e6d7fd47aea9b6d627ec5352.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_71b3fc42e720d82573d4f58f88fbbd7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_71b3fc42e720d82573d4f58f88fbbd7e.jpg not downloaded yet
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee130c290>
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_20e0497e795820b6013957959d30408d.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_20e0497e795820b6013957959d30408d.jpg saved to cache
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27e050c4-721d-58a3-abd4-acdc3dd408a9
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee266cbd0>
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_a91adf740c01a26a0ce6d9b730aaec4c.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_a91adf740c01a26a0ce6d9b730aaec4c.jpg saved to cache
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7faf0559-bf9b-5089-875e-1f82f4519949
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25aaf50>
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_fac9ce52f00684d38d6ae76f2420c756.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_fac9ce52f00684d38d6ae76f2420c756.jpg saved to cache
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 27e050c4-721d-58a3-abd4-acdc3dd408a9
2026-03-30 09:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_295f3559f64f92203b9d939ecbc61206.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:57 [auto1.it] INFO: Found listing with ID: DK43597
2026-03-30 09:06:57 [auto1.it] INFO: Found listing with ID: HY55769
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY55769%27 HTTP/1.1" 200 None
2026-03-30 09:06:57 [auto1.it] INFO: Scrape type for HY55769: 2
2026-03-30 09:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8503f725-034d-5524-b43f-671738f7e653 with identifier: HY55769
2026-03-30 09:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8503f725-034d-5524-b43f-671738f7e653 with scrape type 2
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8503f725-034d-5524-b43f-671738f7e653 with scrape type 2
2026-03-30 09:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8503f725-034d-5524-b43f-671738f7e653, identifier: HY55769
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_f1e577ca481ced93f3786a9336ee1417.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_f1e577ca481ced93f3786a9336ee1417.jpg not downloaded yet
2026-03-30 09:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8503f725-034d-5524-b43f-671738f7e653 with identifier: HY55769
2026-03-30 09:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8503f725-034d-5524-b43f-671738f7e653 with identifier: HY55769
2026-03-30 09:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8503f725-034d-5524-b43f-671738f7e653 with identifier: HY55769 to the API
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:53:35Z',
 'fuel_type': 'diesel',
 'id': '8503f725-034d-5524-b43f-671738f7e653',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY55769',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 147415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-28',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2014}
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY55769%27 HTTP/1.1" 200 None
2026-03-30 09:06:58 [auto1.it] INFO: Saving data for HY55769: {'auction_closing_time': 1774972415.0, 'created_time': 1773135186.530885, 'last_price_update_time': 1774861618.145525}
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY55769') HTTP/1.1" 204 0
2026-03-30 09:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_d5a6f994362b452b5ca2b94e31e256d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_3b2eacca14c99d257754e1ee3fbcc264.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_982c88dcb8b22e870a697dd0658df83f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:58 [auto1.it] INFO: Found listing with ID: LJ03272
2026-03-30 09:06:58 [auto1.it] INFO: Found listing with ID: BW98785
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW98785%27 HTTP/1.1" 200 None
2026-03-30 09:06:58 [auto1.it] INFO: Scrape type for BW98785: 1
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee281f390>
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_f78871261742743a0af1229f79e62093.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_f78871261742743a0af1229f79e62093.jpg saved to cache
2026-03-30 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 27e050c4-721d-58a3-abd4-acdc3dd408a9
2026-03-30 09:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee130fed0>
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Faa%252F20aabbc17daa19289b9700332196f415%252Fpa%252FSC36989_69fe09db54be6479a135e8e797680580.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_69fe09db54be6479a135e8e797680580.jpg saved to cache
2026-03-30 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e58ff75c-8870-52cc-9acd-3f1303e3b574
2026-03-30 09:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e58ff75c-8870-52cc-9acd-3f1303e3b574, skipping ID generation
2026-03-30 09:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e58ff75c-8870-52cc-9acd-3f1303e3b574 with scrape type 1
2026-03-30 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e58ff75c-8870-52cc-9acd-3f1303e3b574 sending to next pipeline
2026-03-30 09:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e58ff75c-8870-52cc-9acd-3f1303e3b574, identifier: SC36989
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee262d450>
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_738246a6e6d7fd47aea9b6d627ec5352.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_738246a6e6d7fd47aea9b6d627ec5352.jpg saved to cache
2026-03-30 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7faf0559-bf9b-5089-875e-1f82f4519949
2026-03-30 09:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_745072b7cd3ad88229b8354c59d95791.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_ebc6662558b28ed5bef63d75e7c64acb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_ebc6662558b28ed5bef63d75e7c64acb.jpg not downloaded yet
2026-03-30 09:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e58ff75c-8870-52cc-9acd-3f1303e3b574 with identifier: SC36989
2026-03-30 09:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e58ff75c-8870-52cc-9acd-3f1303e3b574 with identifier: SC36989
2026-03-30 09:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e58ff75c-8870-52cc-9acd-3f1303e3b574 with identifier: SC36989 to the API
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_69fe09db54be6479a135e8e797680580.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:39:44Z',
 'fuel_type': 'petrol',
 'id': 'e58ff75c-8870-52cc-9acd-3f1303e3b574',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC36989',
 'listing': 'auction',
 'location': 'IT, Valmontone (RM)',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 23119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_09321d4211d9e6d7e03db6c733deb6ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2559835,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_69fe09db54be6479a135e8e797680580.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_36028c7dd7f9e28dde5ae99d6ec76a3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_406178b897902524ac64b1d781d6720c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_e14bab2d77866ace6eef5b4529f89b2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_ef7148f07e27bf7677a8abd28e83af37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_bfb8e0c6c6ff77273d1aee25d9df84cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_ac54acb19bde72706548c0bf0ee40a3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_6b474df09a79e849d04d13423e9a3bc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e58ff75c-8870-52cc-9acd-3f1303e3b574/e58ff75c-8870-52cc-9acd-3f1303e3b574_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/aa/20aabbc17daa19289b9700332196f415/pa/SC36989_83a0c92a920faf806194e2df2bcdf47e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Leon 1.5 eTSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC36989%27 HTTP/1.1" 200 None
2026-03-30 09:06:58 [auto1.it] INFO: Saving data for SC36989: {'created_time': 1774861618.982733, 'last_price_update_time': 1774861618.982746, 'auction_closing_time': 1774971584.0}
2026-03-30 09:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC36989') HTTP/1.1" 204 0
2026-03-30 09:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_c85ca4100c00d5cb260858ab52d62f18.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_c35f37ecb8c59303bea1f00454747c0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:59 [auto1.it] INFO: Found listing with ID: MN95731
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN95731%27 HTTP/1.1" 200 None
2026-03-30 09:06:59 [auto1.it] INFO: Scrape type for MN95731: 2
2026-03-30 09:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6988f204-cae1-5a19-ad67-16b8f9076a18 with identifier: MN95731
2026-03-30 09:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6988f204-cae1-5a19-ad67-16b8f9076a18 with scrape type 2
2026-03-30 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6988f204-cae1-5a19-ad67-16b8f9076a18 with scrape type 2
2026-03-30 09:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6988f204-cae1-5a19-ad67-16b8f9076a18, identifier: MN95731
2026-03-30 09:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee459ad50>
2026-03-30 09:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F5a%252F135a152d618339f3f53e60888f66efd8%252Fpa%252FFD90362_295f3559f64f92203b9d939ecbc61206.jpg') HTTP/1.1" 204 0
2026-03-30 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_295f3559f64f92203b9d939ecbc61206.jpg saved to cache
2026-03-30 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3338be66-0d2b-5217-a485-094598f98b3d
2026-03-30 09:06:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3338be66-0d2b-5217-a485-094598f98b3d, skipping ID generation
2026-03-30 09:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3338be66-0d2b-5217-a485-094598f98b3d with scrape type 1
2026-03-30 09:06:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3338be66-0d2b-5217-a485-094598f98b3d sending to next pipeline
2026-03-30 09:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3338be66-0d2b-5217-a485-094598f98b3d, identifier: FD90362
2026-03-30 09:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_eeb427707c95278a9e484823d1177e4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6988f204-cae1-5a19-ad67-16b8f9076a18 with identifier: MN95731
2026-03-30 09:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6988f204-cae1-5a19-ad67-16b8f9076a18 with identifier: MN95731
2026-03-30 09:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6988f204-cae1-5a19-ad67-16b8f9076a18 with identifier: MN95731 to the API
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:41:26Z',
 'fuel_type': 'diesel',
 'id': '6988f204-cae1-5a19-ad67-16b8f9076a18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN95731',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 231036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-06',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN95731%27 HTTP/1.1" 200 None
2026-03-30 09:06:59 [auto1.it] INFO: Saving data for MN95731: {'auction_closing_time': 1774971686.0, 'created_time': 1774472797.628358, 'last_price_update_time': 1774861619.770097}
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MN95731') HTTP/1.1" 204 0
2026-03-30 09:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3338be66-0d2b-5217-a485-094598f98b3d with identifier: FD90362
2026-03-30 09:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3338be66-0d2b-5217-a485-094598f98b3d with identifier: FD90362
2026-03-30 09:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3338be66-0d2b-5217-a485-094598f98b3d with identifier: FD90362 to the API
2026-03-30 09:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_295f3559f64f92203b9d939ecbc61206.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:41:03Z',
 'fuel_type': 'diesel',
 'id': '3338be66-0d2b-5217-a485-094598f98b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD90362',
 'listing': 'auction',
 'location': 'IT, Mariano Comense',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 154057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_61ef88038637966a25d9571e6d009e47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2409463,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_295f3559f64f92203b9d939ecbc61206.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430778,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_64186aae62903f069d40ddd82c497cc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2322778,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_d66bdd83f731844e0755a27cfdb12e7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_a10222935b114a83898abb6b9e9e26d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2270949,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_eaba5e67be40b703744124c251e27e47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_74458c14f2f321ef628627977c23ab00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_76ff3fbb5ca375be9f847c3ca328e9b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2498410,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_2cc51f2c2517f84357891c71e62db368.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3338be66-0d2b-5217-a485-094598f98b3d/3338be66-0d2b-5217-a485-094598f98b3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2935029,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img13/5a/135a152d618339f3f53e60888f66efd8/pa/FD90362_8e8303f6a9366032e8b0017f4620e734.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Executive BlueMotion',
 'transmission': 'manual',
 'trim': 'Executive BlueMotion',
 'year': 2017}
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD90362%27 HTTP/1.1" 200 None
2026-03-30 09:07:00 [auto1.it] INFO: Saving data for FD90362: {'created_time': 1774861620.256022, 'last_price_update_time': 1774861620.256037, 'auction_closing_time': 1774971663.0}
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FD90362') HTTP/1.1" 204 0
2026-03-30 09:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_e810657402b53e6a686d80d8ae9970ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:00 [auto1.it] INFO: Found listing with ID: BD07482
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD07482%27 HTTP/1.1" 200 None
2026-03-30 09:07:00 [auto1.it] INFO: Scrape type for BD07482: 2
2026-03-30 09:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf2a331a-ef33-5234-a52e-eb99d49a5828 with identifier: BD07482
2026-03-30 09:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf2a331a-ef33-5234-a52e-eb99d49a5828 with scrape type 2
2026-03-30 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf2a331a-ef33-5234-a52e-eb99d49a5828 with scrape type 2
2026-03-30 09:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf2a331a-ef33-5234-a52e-eb99d49a5828, identifier: BD07482
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12381d0>
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_d5a6f994362b452b5ca2b94e31e256d0.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_d5a6f994362b452b5ca2b94e31e256d0.jpg saved to cache
2026-03-30 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26805d0>
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_3b2eacca14c99d257754e1ee3fbcc264.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_3b2eacca14c99d257754e1ee3fbcc264.jpg saved to cache
2026-03-30 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 27e050c4-721d-58a3-abd4-acdc3dd408a9
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25d8b10>
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_982c88dcb8b22e870a697dd0658df83f.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_982c88dcb8b22e870a697dd0658df83f.jpg saved to cache
2026-03-30 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 27e050c4-721d-58a3-abd4-acdc3dd408a9
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee263c6d0>
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_745072b7cd3ad88229b8354c59d95791.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_745072b7cd3ad88229b8354c59d95791.jpg saved to cache
2026-03-30 09:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7faf0559-bf9b-5089-875e-1f82f4519949
2026-03-30 09:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf2a331a-ef33-5234-a52e-eb99d49a5828 with identifier: BD07482
2026-03-30 09:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf2a331a-ef33-5234-a52e-eb99d49a5828 with identifier: BD07482
2026-03-30 09:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf2a331a-ef33-5234-a52e-eb99d49a5828 with identifier: BD07482 to the API
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:18:12Z',
 'fuel_type': 'diesel',
 'id': 'bf2a331a-ef33-5234-a52e-eb99d49a5828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD07482',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 150451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-28',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2013}
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD07482%27 HTTP/1.1" 200 None
2026-03-30 09:07:00 [auto1.it] INFO: Saving data for BD07482: {'auction_closing_time': 1774970292.0, 'created_time': 1774386510.66441, 'last_price_update_time': 1774861620.996456}
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BD07482') HTTP/1.1" 204 0
2026-03-30 09:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2623090>
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_c85ca4100c00d5cb260858ab52d62f18.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_c85ca4100c00d5cb260858ab52d62f18.jpg saved to cache
2026-03-30 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2572010>
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_c35f37ecb8c59303bea1f00454747c0c.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_c35f37ecb8c59303bea1f00454747c0c.jpg saved to cache
2026-03-30 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27e050c4-721d-58a3-abd4-acdc3dd408a9
2026-03-30 09:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_1cadf70d5b516a55008d836f2101afc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_fa17bd822d9582b364b5dbc7445ec489.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_f3f85c305f9e48f35a89b2a2a73300ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:01 [auto1.it] INFO: Found listing with ID: FK09468
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK09468%27 HTTP/1.1" 200 None
2026-03-30 09:07:01 [auto1.it] INFO: Scrape type for FK09468: 2
2026-03-30 09:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d5b3f9f-29c0-5841-8171-4c47b151ee88 with identifier: FK09468
2026-03-30 09:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88 with scrape type 2
2026-03-30 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88 with scrape type 2
2026-03-30 09:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d5b3f9f-29c0-5841-8171-4c47b151ee88, identifier: FK09468
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1485e50>
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_eeb427707c95278a9e484823d1177e4f.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_eeb427707c95278a9e484823d1177e4f.jpg saved to cache
2026-03-30 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9
2026-03-30 09:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d5b3f9f-29c0-5841-8171-4c47b151ee88 with identifier: FK09468
2026-03-30 09:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d5b3f9f-29c0-5841-8171-4c47b151ee88 with identifier: FK09468
2026-03-30 09:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d5b3f9f-29c0-5841-8171-4c47b151ee88 with identifier: FK09468 to the API
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:17:43Z',
 'fuel_type': 'diesel',
 'id': '4d5b3f9f-29c0-5841-8171-4c47b151ee88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK09468',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 105561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-30',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Sport FWD',
 'transmission': 'manual',
 'trim': 'Sport FWD',
 'year': 2018}
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK09468%27 HTTP/1.1" 200 None
2026-03-30 09:07:01 [auto1.it] INFO: Saving data for FK09468: {'auction_closing_time': 1774970263.0, 'created_time': 1774361219.439175, 'last_price_update_time': 1774861621.677777}
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FK09468') HTTP/1.1" 204 0
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25d8910>
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_e810657402b53e6a686d80d8ae9970ce.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_e810657402b53e6a686d80d8ae9970ce.jpg saved to cache
2026-03-30 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 27e050c4-721d-58a3-abd4-acdc3dd408a9
2026-03-30 09:07:01 [auto1.it] INFO: Found listing with ID: WR41361
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR41361%27 HTTP/1.1" 200 None
2026-03-30 09:07:01 [auto1.it] INFO: Scrape type for WR41361: 2
2026-03-30 09:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with identifier: WR41361
2026-03-30 09:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with scrape type 2
2026-03-30 09:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with scrape type 2
2026-03-30 09:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aedcd70f-872d-5b95-9bcd-5e15d1563ed9, identifier: WR41361
2026-03-30 09:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with identifier: WR41361
2026-03-30 09:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with identifier: WR41361
2026-03-30 09:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aedcd70f-872d-5b95-9bcd-5e15d1563ed9 with identifier: WR41361 to the API
2026-03-30 09:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:17:36Z',
 'fuel_type': 'petrol',
 'id': 'aedcd70f-872d-5b95-9bcd-5e15d1563ed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR41361',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 174078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.2 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2014}
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR41361%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Saving data for WR41361: {'auction_closing_time': 1774970256.0, 'created_time': 1774473119.052966, 'last_price_update_time': 1774861622.223832}
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WR41361') HTTP/1.1" 204 0
2026-03-30 09:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c6fd0>
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F08%252F9008267a0bfa9bd6feb63b77af544362%252Fpa%252FDA30561_1cadf70d5b516a55008d836f2101afc4.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_1cadf70d5b516a55008d836f2101afc4.jpg saved to cache
2026-03-30 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34df70c4-3a7e-5022-913d-5811e4275b13
2026-03-30 09:07:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34df70c4-3a7e-5022-913d-5811e4275b13, skipping ID generation
2026-03-30 09:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34df70c4-3a7e-5022-913d-5811e4275b13 with scrape type 1
2026-03-30 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34df70c4-3a7e-5022-913d-5811e4275b13 sending to next pipeline
2026-03-30 09:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34df70c4-3a7e-5022-913d-5811e4275b13, identifier: DA30561
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee14859d0>
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_fa17bd822d9582b364b5dbc7445ec489.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_fa17bd822d9582b364b5dbc7445ec489.jpg saved to cache
2026-03-30 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10917d0>
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_f3f85c305f9e48f35a89b2a2a73300ff.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_f3f85c305f9e48f35a89b2a2a73300ff.jpg saved to cache
2026-03-30 09:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 27e050c4-721d-58a3-abd4-acdc3dd408a9
2026-03-30 09:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_58ccc6405ada0ef878842ef3ba96f2f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_71b3fc42e720d82573d4f58f88fbbd7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_f1e577ca481ced93f3786a9336ee1417.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_306d308e1d5d938eb79b73fa7011f72e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:02 [auto1.it] INFO: Found listing with ID: RP34917
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP34917%27 HTTP/1.1" 200 None
2026-03-30 09:07:02 [auto1.it] INFO: Scrape type for RP34917: 1
2026-03-30 09:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34df70c4-3a7e-5022-913d-5811e4275b13 with identifier: DA30561
2026-03-30 09:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34df70c4-3a7e-5022-913d-5811e4275b13 with identifier: DA30561
2026-03-30 09:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34df70c4-3a7e-5022-913d-5811e4275b13 with identifier: DA30561 to the API
2026-03-30 09:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_1cadf70d5b516a55008d836f2101afc4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:09:32Z',
 'fuel_type': 'diesel',
 'id': '34df70c4-3a7e-5022-913d-5811e4275b13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA30561',
 'listing': 'auction',
 'location': 'IT, Ferrara',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 136880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_1cadf70d5b516a55008d836f2101afc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_c9d7b8b9108968942ad881758d902e85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_38726bc17ac5541115d0d8df7c8099a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_48509a01df9c12bd1acb43f1600f03bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_e30142390bf0f3c7fe0f3321b398f0d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2795723,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_f2148e359f36519b815fc48b835bde32.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_3bcc53cc948312647dd5932119cb494e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_00762108c415d1521f01d908a1cf0351.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_41bdecc48d1762d4f95b41e089731a60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34df70c4-3a7e-5022-913d-5811e4275b13/34df70c4-3a7e-5022-913d-5811e4275b13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/08/9008267a0bfa9bd6feb63b77af544362/pa/DA30561_b7925c4fbce39dfe2de02027219965fe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA30561%27 HTTP/1.1" 200 None
2026-03-30 09:07:03 [auto1.it] INFO: Saving data for DA30561: {'created_time': 1774861623.968853, 'last_price_update_time': 1774861623.968865, 'auction_closing_time': 1774969772.0}
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA30561') HTTP/1.1" 204 0
2026-03-30 09:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: BX26430
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX26430%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for BX26430: 2
2026-03-30 09:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33f8eaac-7a68-5eda-b598-41010937b23f with identifier: BX26430
2026-03-30 09:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33f8eaac-7a68-5eda-b598-41010937b23f with scrape type 2
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33f8eaac-7a68-5eda-b598-41010937b23f with scrape type 2
2026-03-30 09:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33f8eaac-7a68-5eda-b598-41010937b23f, identifier: BX26430
2026-03-30 09:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33f8eaac-7a68-5eda-b598-41010937b23f with identifier: BX26430
2026-03-30 09:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33f8eaac-7a68-5eda-b598-41010937b23f with identifier: BX26430
2026-03-30 09:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33f8eaac-7a68-5eda-b598-41010937b23f with identifier: BX26430 to the API
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:00:56Z',
 'fuel_type': 'diesel',
 'id': '33f8eaac-7a68-5eda-b598-41010937b23f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX26430',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 338067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Line BlueMotion Tech.',
 'transmission': 'automatic',
 'trim': 'Business Line BlueMotion Tech.',
 'year': 2017}
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX26430%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Saving data for BX26430: {'auction_closing_time': 1774969256.0, 'created_time': 1774354010.918057, 'last_price_update_time': 1774861624.488253}
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BX26430') HTTP/1.1" 204 0
2026-03-30 09:07:04 [scrapy.extensions.logstats] INFO: Crawled 150 pages (at 72 pages/min), scraped 88 items (at 49 items/min)
2026-03-30 09:07:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: VB85022
2026-03-30 09:07:04 [auto1.it] INFO: Found listing with ID: SP78174
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP78174%27 HTTP/1.1" 200 None
2026-03-30 09:07:04 [auto1.it] INFO: Scrape type for SP78174: 2
2026-03-30 09:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768389c3-ebef-53cd-8652-3f921b9f7076 with identifier: SP78174
2026-03-30 09:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768389c3-ebef-53cd-8652-3f921b9f7076 with scrape type 2
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 768389c3-ebef-53cd-8652-3f921b9f7076 with scrape type 2
2026-03-30 09:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 768389c3-ebef-53cd-8652-3f921b9f7076, identifier: SP78174
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1084bd0>
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_58ccc6405ada0ef878842ef3ba96f2f6.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_58ccc6405ada0ef878842ef3ba96f2f6.jpg saved to cache
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7faf0559-bf9b-5089-875e-1f82f4519949
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27366d0>
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_71b3fc42e720d82573d4f58f88fbbd7e.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_71b3fc42e720d82573d4f58f88fbbd7e.jpg saved to cache
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26f0ed0>
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_f1e577ca481ced93f3786a9336ee1417.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_f1e577ca481ced93f3786a9336ee1417.jpg saved to cache
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c4810>
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252F31%252F0f319f464214faceee7ab1e1bf06fffb%252Fpa%252FJU77686_306d308e1d5d938eb79b73fa7011f72e.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_306d308e1d5d938eb79b73fa7011f72e.jpg saved to cache
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27e050c4-721d-58a3-abd4-acdc3dd408a9
2026-03-30 09:07:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 27e050c4-721d-58a3-abd4-acdc3dd408a9, skipping ID generation
2026-03-30 09:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e050c4-721d-58a3-abd4-acdc3dd408a9 with scrape type 1
2026-03-30 09:07:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27e050c4-721d-58a3-abd4-acdc3dd408a9 sending to next pipeline
2026-03-30 09:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27e050c4-721d-58a3-abd4-acdc3dd408a9, identifier: JU77686
2026-03-30 09:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 768389c3-ebef-53cd-8652-3f921b9f7076 with identifier: SP78174
2026-03-30 09:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 768389c3-ebef-53cd-8652-3f921b9f7076 with identifier: SP78174
2026-03-30 09:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 768389c3-ebef-53cd-8652-3f921b9f7076 with identifier: SP78174 to the API
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:41:09Z',
 'fuel_type': 'diesel',
 'id': '768389c3-ebef-53cd-8652-3f921b9f7076',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP78174',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 211368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Business 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business 4Motion BlueMotion',
 'year': 2017}
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP78174%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Saving data for SP78174: {'auction_closing_time': 1774971669.0, 'created_time': 1774386710.452091, 'last_price_update_time': 1774861625.453089}
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SP78174') HTTP/1.1" 204 0
2026-03-30 09:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27e050c4-721d-58a3-abd4-acdc3dd408a9 with identifier: JU77686
2026-03-30 09:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27e050c4-721d-58a3-abd4-acdc3dd408a9 with identifier: JU77686
2026-03-30 09:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 27e050c4-721d-58a3-abd4-acdc3dd408a9 with identifier: JU77686 to the API
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_306d308e1d5d938eb79b73fa7011f72e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:03:20Z',
 'fuel_type': 'petrol',
 'id': '27e050c4-721d-58a3-abd4-acdc3dd408a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU77686',
 'listing': 'auction',
 'location': 'IT, Marino',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 97996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_2d3116565364632876744d3f3e4da726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_fac9ce52f00684d38d6ae76f2420c756.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_20e0497e795820b6013957959d30408d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_f78871261742743a0af1229f79e62093.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_982c88dcb8b22e870a697dd0658df83f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_3b2eacca14c99d257754e1ee3fbcc264.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_f3f85c305f9e48f35a89b2a2a73300ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_e810657402b53e6a686d80d8ae9970ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_c35f37ecb8c59303bea1f00454747c0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e050c4-721d-58a3-abd4-acdc3dd408a9/27e050c4-721d-58a3-abd4-acdc3dd408a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/31/0f319f464214faceee7ab1e1bf06fffb/pa/JU77686_306d308e1d5d938eb79b73fa7011f72e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Verso 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU77686%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Saving data for JU77686: {'created_time': 1774861625.946855, 'last_price_update_time': 1774861625.946867, 'auction_closing_time': 1774969400.0}
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JU77686') HTTP/1.1" 204 0
2026-03-30 09:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_5a3b5829656f054fd4906b174bb70b19.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_26a3cbb93f86c394a8e7862045402e05.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_8417647a8ad30977ff787c2d3c039cbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_0738a7321546a844e90a22f9434ba282.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:05 [auto1.it] INFO: Found listing with ID: KY18822
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY18822%27 HTTP/1.1" 200 None
2026-03-30 09:07:05 [auto1.it] INFO: Scrape type for KY18822: 2
2026-03-30 09:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47eb52c9-0304-5945-8bc9-1473c6945d9b with identifier: KY18822
2026-03-30 09:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47eb52c9-0304-5945-8bc9-1473c6945d9b with scrape type 2
2026-03-30 09:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47eb52c9-0304-5945-8bc9-1473c6945d9b with scrape type 2
2026-03-30 09:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47eb52c9-0304-5945-8bc9-1473c6945d9b, identifier: KY18822
2026-03-30 09:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47eb52c9-0304-5945-8bc9-1473c6945d9b with identifier: KY18822
2026-03-30 09:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47eb52c9-0304-5945-8bc9-1473c6945d9b with identifier: KY18822
2026-03-30 09:07:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 47eb52c9-0304-5945-8bc9-1473c6945d9b with identifier: KY18822 to the API
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:41:16Z',
 'fuel_type': 'diesel',
 'id': '47eb52c9-0304-5945-8bc9-1473c6945d9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY18822',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 51031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-21',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Limited',
 'transmission': 'manual',
 'trim': 'Doppelkabine 4x4 Limited',
 'year': 2022}
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY18822%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Saving data for KY18822: {'auction_closing_time': 1774971676.0, 'created_time': 1774440467.263099, 'last_price_update_time': 1774861626.474765}
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KY18822') HTTP/1.1" 204 0
2026-03-30 09:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: RL10918
2026-03-30 09:07:06 [auto1.it] INFO: Found listing with ID: WL49427
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL49427%27 HTTP/1.1" 200 None
2026-03-30 09:07:06 [auto1.it] INFO: Scrape type for WL49427: 2
2026-03-30 09:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe6eb15-ac32-5175-86b2-005eedfbb149 with identifier: WL49427
2026-03-30 09:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe6eb15-ac32-5175-86b2-005eedfbb149 with scrape type 2
2026-03-30 09:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fe6eb15-ac32-5175-86b2-005eedfbb149 with scrape type 2
2026-03-30 09:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8fe6eb15-ac32-5175-86b2-005eedfbb149, identifier: WL49427
2026-03-30 09:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8fe6eb15-ac32-5175-86b2-005eedfbb149 with identifier: WL49427
2026-03-30 09:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8fe6eb15-ac32-5175-86b2-005eedfbb149 with identifier: WL49427
2026-03-30 09:07:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8fe6eb15-ac32-5175-86b2-005eedfbb149 with identifier: WL49427 to the API
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:16:10Z',
 'fuel_type': 'diesel',
 'id': '8fe6eb15-ac32-5175-86b2-005eedfbb149',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL49427',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 107478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-29',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 HDi X Line',
 'transmission': 'manual',
 'trim': 'X Line',
 'year': 2008}
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL49427%27 HTTP/1.1" 200 None
2026-03-30 09:07:07 [auto1.it] INFO: Saving data for WL49427: {'auction_closing_time': 1774970170.0, 'created_time': 1774472802.640042, 'last_price_update_time': 1774861627.044135}
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WL49427') HTTP/1.1" 204 0
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11ba590>
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc3%252Fcfc3c6679c33f2962be8f5ea1ab07431%252Fpa%252FYA01979_5a3b5829656f054fd4906b174bb70b19.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_5a3b5829656f054fd4906b174bb70b19.jpg saved to cache
2026-03-30 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7faf0559-bf9b-5089-875e-1f82f4519949
2026-03-30 09:07:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7faf0559-bf9b-5089-875e-1f82f4519949, skipping ID generation
2026-03-30 09:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7faf0559-bf9b-5089-875e-1f82f4519949 with scrape type 1
2026-03-30 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7faf0559-bf9b-5089-875e-1f82f4519949 sending to next pipeline
2026-03-30 09:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7faf0559-bf9b-5089-875e-1f82f4519949, identifier: YA01979
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee266c790>
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_26a3cbb93f86c394a8e7862045402e05.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_26a3cbb93f86c394a8e7862045402e05.jpg saved to cache
2026-03-30 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d628d6c2-6eee-5ba7-bf02-527049a3c587
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12492d0>
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_8417647a8ad30977ff787c2d3c039cbf.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_8417647a8ad30977ff787c2d3c039cbf.jpg saved to cache
2026-03-30 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37a65657-0884-595c-9188-1906d489adba
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee45e3790>
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_0738a7321546a844e90a22f9434ba282.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_0738a7321546a844e90a22f9434ba282.jpg saved to cache
2026-03-30 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c
2026-03-30 09:07:07 [auto1.it] INFO: Found listing with ID: EL74502
2026-03-30 09:07:07 [auto1.it] INFO: Found listing with ID: MY36901
2026-03-30 09:07:07 [auto1.it] INFO: Found listing with ID: FD49777
2026-03-30 09:07:07 [auto1.it] INFO: Found listing with ID: FX24983
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX24983%27 HTTP/1.1" 200 None
2026-03-30 09:07:07 [auto1.it] INFO: Scrape type for FX24983: 2
2026-03-30 09:07:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c8b5768-3132-570a-80d0-1fd83a584b5f with identifier: FX24983
2026-03-30 09:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c8b5768-3132-570a-80d0-1fd83a584b5f with scrape type 2
2026-03-30 09:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c8b5768-3132-570a-80d0-1fd83a584b5f with scrape type 2
2026-03-30 09:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c8b5768-3132-570a-80d0-1fd83a584b5f, identifier: FX24983
2026-03-30 09:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7faf0559-bf9b-5089-875e-1f82f4519949 with identifier: YA01979
2026-03-30 09:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7faf0559-bf9b-5089-875e-1f82f4519949 with identifier: YA01979
2026-03-30 09:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7faf0559-bf9b-5089-875e-1f82f4519949 with identifier: YA01979 to the API
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_5a3b5829656f054fd4906b174bb70b19.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:05Z',
 'fuel_type': 'diesel',
 'id': '7faf0559-bf9b-5089-875e-1f82f4519949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA01979',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 128730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_34a80cf7462eab56566b4890c51b2551.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_9f1e396697557ead28da0f07b8b91437.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_b8078f86875b389be80112bec7120c07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_abf475999ac91ccdb817e0af26669087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_5a3b5829656f054fd4906b174bb70b19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_2f74f4bf30488d69042cfb6ee4436f8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_a91adf740c01a26a0ce6d9b730aaec4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_58ccc6405ada0ef878842ef3ba96f2f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_738246a6e6d7fd47aea9b6d627ec5352.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7faf0559-bf9b-5089-875e-1f82f4519949/7faf0559-bf9b-5089-875e-1f82f4519949_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c3/cfc3c6679c33f2962be8f5ea1ab07431/pa/YA01979_745072b7cd3ad88229b8354c59d95791.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2017}
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA01979%27 HTTP/1.1" 200 None
2026-03-30 09:07:07 [auto1.it] INFO: Saving data for YA01979: {'created_time': 1774861627.887724, 'last_price_update_time': 1774861627.887734, 'auction_closing_time': 1774972445.0}
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YA01979') HTTP/1.1" 204 0
2026-03-30 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_499f8a3246a4e743b640aacbedb0b1a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_887eecd57fa29ed777fd76b8e794d074.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c8b5768-3132-570a-80d0-1fd83a584b5f with identifier: FX24983
2026-03-30 09:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 09:07:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c8b5768-3132-570a-80d0-1fd83a584b5f with identifier: FX24983
2026-03-30 09:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c8b5768-3132-570a-80d0-1fd83a584b5f with identifier: FX24983 to the API
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:43:27Z',
 'fuel_type': 'petrol',
 'id': '4c8b5768-3132-570a-80d0-1fd83a584b5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX24983',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Avenger',
 'odometer': 25325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-27',
 'seller_name': None,
 'title': 'Jeep Avenger 1.2 T-GDI Altitude',
 'transmission': 'manual',
 'trim': 'Altitude',
 'year': 2024}
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX24983%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Saving data for FX24983: {'auction_closing_time': 1774971807.0, 'created_time': 1774472724.452396, 'last_price_update_time': 1774861628.442125}
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FX24983') HTTP/1.1" 204 0
2026-03-30 09:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_b36801e5b95d9de73ced57c3f5d284eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_62027ba722c45ff52168eb7fe918b297.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:08 [auto1.it] INFO: Found listing with ID: DN10540
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN10540%27 HTTP/1.1" 200 None
2026-03-30 09:07:08 [auto1.it] INFO: Scrape type for DN10540: 2
2026-03-30 09:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe5f7f4-b653-5264-88c3-d992dbcfef59 with identifier: DN10540
2026-03-30 09:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe5f7f4-b653-5264-88c3-d992dbcfef59 with scrape type 2
2026-03-30 09:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fe5f7f4-b653-5264-88c3-d992dbcfef59 with scrape type 2
2026-03-30 09:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8fe5f7f4-b653-5264-88c3-d992dbcfef59, identifier: DN10540
2026-03-30 09:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW98785/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8fe5f7f4-b653-5264-88c3-d992dbcfef59 with identifier: DN10540
2026-03-30 09:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8fe5f7f4-b653-5264-88c3-d992dbcfef59 with identifier: DN10540
2026-03-30 09:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8fe5f7f4-b653-5264-88c3-d992dbcfef59 with identifier: DN10540 to the API
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:34:04Z',
 'fuel_type': 'petrol',
 'id': '8fe5f7f4-b653-5264-88c3-d992dbcfef59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN10540',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 217516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-15',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Climbing 4x4',
 'transmission': 'manual',
 'trim': 'Climbing 4x4',
 'year': 2006}
2026-03-30 09:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN10540%27 HTTP/1.1" 200 None
2026-03-30 09:07:09 [auto1.it] INFO: Saving data for DN10540: {'auction_closing_time': 1774971244.0, 'created_time': 1774386358.975033, 'last_price_update_time': 1774861629.011351}
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DN10540') HTTP/1.1" 204 0
2026-03-30 09:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK67266/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:09 [auto1.it] INFO: Found listing with ID: JZ33949
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ33949%27 HTTP/1.1" 200 None
2026-03-30 09:07:09 [auto1.it] INFO: Scrape type for JZ33949: 2
2026-03-30 09:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88a26016-6cde-5969-898f-5ac047e7268b with identifier: JZ33949
2026-03-30 09:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88a26016-6cde-5969-898f-5ac047e7268b with scrape type 2
2026-03-30 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88a26016-6cde-5969-898f-5ac047e7268b with scrape type 2
2026-03-30 09:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 88a26016-6cde-5969-898f-5ac047e7268b, identifier: JZ33949
2026-03-30 09:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ74890/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV38017> (referer: https://www.auto1.com/v1/car-details-view/RV38017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 88a26016-6cde-5969-898f-5ac047e7268b with identifier: JZ33949
2026-03-30 09:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 88a26016-6cde-5969-898f-5ac047e7268b with identifier: JZ33949
2026-03-30 09:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 88a26016-6cde-5969-898f-5ac047e7268b with identifier: JZ33949 to the API
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:09:59Z',
 'fuel_type': 'diesel',
 'id': '88a26016-6cde-5969-898f-5ac047e7268b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ33949',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 284245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2020}
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ33949%27 HTTP/1.1" 200 None
2026-03-30 09:07:09 [auto1.it] INFO: Saving data for JZ33949: {'auction_closing_time': 1774969799.0, 'created_time': 1774440358.784389, 'last_price_update_time': 1774861629.504668}
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ33949') HTTP/1.1" 204 0
2026-03-30 09:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1124bd0>
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_499f8a3246a4e743b640aacbedb0b1a2.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_499f8a3246a4e743b640aacbedb0b1a2.jpg saved to cache
2026-03-30 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d628d6c2-6eee-5ba7-bf02-527049a3c587
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2689d90>
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_887eecd57fa29ed777fd76b8e794d074.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_887eecd57fa29ed777fd76b8e794d074.jpg saved to cache
2026-03-30 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c4f10>
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_b36801e5b95d9de73ced57c3f5d284eb.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_b36801e5b95d9de73ced57c3f5d284eb.jpg saved to cache
2026-03-30 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37a65657-0884-595c-9188-1906d489adba
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee269f750>
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_62027ba722c45ff52168eb7fe918b297.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_62027ba722c45ff52168eb7fe918b297.jpg saved to cache
2026-03-30 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c
2026-03-30 09:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_312f2cf381d261b95b5fe62023249dd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_ae043554dcfb42cf39912896caa45d0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_7871f13b9fb9a64c706f9b3968645e3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:09 [auto1.it] INFO: Found listing with ID: TB83381
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB83381%27 HTTP/1.1" 200 None
2026-03-30 09:07:09 [auto1.it] INFO: Scrape type for TB83381: 2
2026-03-30 09:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f630c70a-06e1-51ff-8211-a48430768a44 with identifier: TB83381
2026-03-30 09:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f630c70a-06e1-51ff-8211-a48430768a44 with scrape type 2
2026-03-30 09:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f630c70a-06e1-51ff-8211-a48430768a44 with scrape type 2
2026-03-30 09:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f630c70a-06e1-51ff-8211-a48430768a44, identifier: TB83381
2026-03-30 09:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f630c70a-06e1-51ff-8211-a48430768a44 with identifier: TB83381
2026-03-30 09:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f630c70a-06e1-51ff-8211-a48430768a44 with identifier: TB83381
2026-03-30 09:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f630c70a-06e1-51ff-8211-a48430768a44 with identifier: TB83381 to the API
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:31:20Z',
 'fuel_type': 'diesel',
 'id': 'f630c70a-06e1-51ff-8211-a48430768a44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB83381',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 81813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Premium',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Premium',
 'year': 2017}
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB83381%27 HTTP/1.1" 200 None
2026-03-30 09:07:10 [auto1.it] INFO: Saving data for TB83381: {'auction_closing_time': 1774971080.0, 'created_time': 1774354568.988748, 'last_price_update_time': 1774861630.444944}
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TB83381') HTTP/1.1" 204 0
2026-03-30 09:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_a638bcea24fec8aa5228d1e29905dc3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:10 [auto1.it] INFO: Found listing with ID: VM11321
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM11321%27 HTTP/1.1" 200 None
2026-03-30 09:07:10 [auto1.it] INFO: Scrape type for VM11321: 2
2026-03-30 09:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f82ab88-04b0-5bb3-86b8-5db6ee0997b1 with identifier: VM11321
2026-03-30 09:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f82ab88-04b0-5bb3-86b8-5db6ee0997b1 with scrape type 2
2026-03-30 09:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f82ab88-04b0-5bb3-86b8-5db6ee0997b1 with scrape type 2
2026-03-30 09:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f82ab88-04b0-5bb3-86b8-5db6ee0997b1, identifier: VM11321
2026-03-30 09:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5 with identifier: RV38017
2026-03-30 09:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5 with scrape type 1
2026-03-30 09:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_9fd1d3f67c4894cf251b1daea4544371.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_9fd1d3f67c4894cf251b1daea4544371.jpg not downloaded yet
2026-03-30 09:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_13344dc1dfdca722fe792eb99254e82e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f82ab88-04b0-5bb3-86b8-5db6ee0997b1 with identifier: VM11321
2026-03-30 09:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f82ab88-04b0-5bb3-86b8-5db6ee0997b1 with identifier: VM11321
2026-03-30 09:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f82ab88-04b0-5bb3-86b8-5db6ee0997b1 with identifier: VM11321 to the API
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:22:22Z',
 'fuel_type': 'petrol',
 'id': '4f82ab88-04b0-5bb3-86b8-5db6ee0997b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM11321',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 36556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-18',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM11321%27 HTTP/1.1" 200 None
2026-03-30 09:07:10 [auto1.it] INFO: Saving data for VM11321: {'auction_closing_time': 1774970542.0, 'created_time': 1773267268.031274, 'last_price_update_time': 1774861630.984047}
2026-03-30 09:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VM11321') HTTP/1.1" 204 0
2026-03-30 09:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_198e8ee7678617571ff6488586ed0083.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_c44f15318cfc8c27de48df5a4beeef3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:11 [auto1.it] INFO: Found listing with ID: KL91026
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL91026%27 HTTP/1.1" 200 None
2026-03-30 09:07:11 [auto1.it] INFO: Scrape type for KL91026: 2
2026-03-30 09:07:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0179f5bb-6b0e-5cc0-9246-955f9ed6e4ca with identifier: KL91026
2026-03-30 09:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0179f5bb-6b0e-5cc0-9246-955f9ed6e4ca with scrape type 2
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0179f5bb-6b0e-5cc0-9246-955f9ed6e4ca with scrape type 2
2026-03-30 09:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0179f5bb-6b0e-5cc0-9246-955f9ed6e4ca, identifier: KL91026
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_d05a4570144da7450b88e4197314495a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_d05a4570144da7450b88e4197314495a.jpg not downloaded yet
2026-03-30 09:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB21733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RP34917/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2755950>
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_312f2cf381d261b95b5fe62023249dd9.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_312f2cf381d261b95b5fe62023249dd9.jpg saved to cache
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37a65657-0884-595c-9188-1906d489adba
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee257d510>
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_ae043554dcfb42cf39912896caa45d0b.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_ae043554dcfb42cf39912896caa45d0b.jpg saved to cache
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d628d6c2-6eee-5ba7-bf02-527049a3c587
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee109c510>
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_7871f13b9fb9a64c706f9b3968645e3e.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_7871f13b9fb9a64c706f9b3968645e3e.jpg saved to cache
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c
2026-03-30 09:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_a5fa78831a6045c8f6559331550c5e0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0179f5bb-6b0e-5cc0-9246-955f9ed6e4ca with identifier: KL91026
2026-03-30 09:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0179f5bb-6b0e-5cc0-9246-955f9ed6e4ca with identifier: KL91026
2026-03-30 09:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0179f5bb-6b0e-5cc0-9246-955f9ed6e4ca with identifier: KL91026 to the API
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:47:08Z',
 'fuel_type': 'diesel',
 'id': '0179f5bb-6b0e-5cc0-9246-955f9ed6e4ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL91026',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Malibu',
 'odometer': 151142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-31',
 'seller_name': None,
 'title': 'Chevrolet Malibu 2.0 Diesel LTZ',
 'transmission': 'automatic',
 'trim': 'LTZ',
 'year': 2013}
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL91026%27 HTTP/1.1" 200 None
2026-03-30 09:07:11 [auto1.it] INFO: Saving data for KL91026: {'auction_closing_time': 1774972028.0, 'created_time': 1774440437.772181, 'last_price_update_time': 1774861631.68126}
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KL91026') HTTP/1.1" 204 0
2026-03-30 09:07:11 [auto1.it] INFO: Found listing with ID: GD21470
2026-03-30 09:07:11 [auto1.it] INFO: Found listing with ID: LX69151
2026-03-30 09:07:11 [auto1.it] INFO: Found listing with ID: SW80726
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW80726%27 HTTP/1.1" 200 None
2026-03-30 09:07:11 [auto1.it] INFO: Scrape type for SW80726: 2
2026-03-30 09:07:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b54b3fdd-6af2-5ba0-969b-720bb4f72c3b with identifier: SW80726
2026-03-30 09:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b54b3fdd-6af2-5ba0-969b-720bb4f72c3b with scrape type 2
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b54b3fdd-6af2-5ba0-969b-720bb4f72c3b with scrape type 2
2026-03-30 09:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b54b3fdd-6af2-5ba0-969b-720bb4f72c3b, identifier: SW80726
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_1eec34761ceeba8cb08758945e3548eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_1eec34761ceeba8cb08758945e3548eb.jpg not downloaded yet
2026-03-30 09:07:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee274ccd0>
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_a638bcea24fec8aa5228d1e29905dc3f.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_a638bcea24fec8aa5228d1e29905dc3f.jpg saved to cache
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee111acd0>
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_13344dc1dfdca722fe792eb99254e82e.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_13344dc1dfdca722fe792eb99254e82e.jpg saved to cache
2026-03-30 09:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d628d6c2-6eee-5ba7-bf02-527049a3c587
2026-03-30 09:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b54b3fdd-6af2-5ba0-969b-720bb4f72c3b with identifier: SW80726
2026-03-30 09:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b54b3fdd-6af2-5ba0-969b-720bb4f72c3b with identifier: SW80726
2026-03-30 09:07:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b54b3fdd-6af2-5ba0-969b-720bb4f72c3b with identifier: SW80726 to the API
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:28:23Z',
 'fuel_type': 'diesel',
 'id': 'b54b3fdd-6af2-5ba0-969b-720bb4f72c3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW80726',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 195777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-31',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Wave',
 'transmission': 'manual',
 'trim': 'Wave',
 'year': 2013}
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW80726%27 HTTP/1.1" 200 None
2026-03-30 09:07:12 [auto1.it] INFO: Saving data for SW80726: {'auction_closing_time': 1774970903.0, 'created_time': 1772524857.874668, 'last_price_update_time': 1774861632.378017}
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SW80726') HTTP/1.1" 204 0
2026-03-30 09:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_cd5a8b106e7a79cf7f20c1391d540799.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_34cb8913a61a9670030e40054065eb2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_d7f255bfe3edc5632259522ff948ba8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:12 [auto1.it] INFO: Found listing with ID: ZL23627
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL23627%27 HTTP/1.1" 200 None
2026-03-30 09:07:12 [auto1.it] INFO: Scrape type for ZL23627: 2
2026-03-30 09:07:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41ca86f7-64a8-5111-8e0c-0d0eb9b1921b with identifier: ZL23627
2026-03-30 09:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41ca86f7-64a8-5111-8e0c-0d0eb9b1921b with scrape type 2
2026-03-30 09:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41ca86f7-64a8-5111-8e0c-0d0eb9b1921b with scrape type 2
2026-03-30 09:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 41ca86f7-64a8-5111-8e0c-0d0eb9b1921b, identifier: ZL23627
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_8aefbd8021d3704774d6943c03a3d06e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_8aefbd8021d3704774d6943c03a3d06e.jpg not downloaded yet
2026-03-30 09:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 41ca86f7-64a8-5111-8e0c-0d0eb9b1921b with identifier: ZL23627
2026-03-30 09:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 41ca86f7-64a8-5111-8e0c-0d0eb9b1921b with identifier: ZL23627
2026-03-30 09:07:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 41ca86f7-64a8-5111-8e0c-0d0eb9b1921b with identifier: ZL23627 to the API
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-31T15:08:04Z',
 'fuel_type': 'petrol',
 'id': '41ca86f7-64a8-5111-8e0c-0d0eb9b1921b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL23627',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 126605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-27',
 'seller_name': None,
 'title': 'Toyota Avensis 1.8 Sol',
 'transmission': 'automatic',
 'trim': 'Sol',
 'year': 2010}
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL23627%27 HTTP/1.1" 200 None
2026-03-30 09:07:12 [auto1.it] INFO: Saving data for ZL23627: {'auction_closing_time': 1774969684.0, 'created_time': 1774040737.356717, 'last_price_update_time': 1774861632.95801}
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZL23627') HTTP/1.1" 204 0
2026-03-30 09:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26091d0>
2026-03-30 09:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_198e8ee7678617571ff6488586ed0083.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_198e8ee7678617571ff6488586ed0083.jpg saved to cache
2026-03-30 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c
2026-03-30 09:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12e5050>
2026-03-30 09:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F81%252Fac81686f7b5e6a234b5b7f5ee96f637a%252Fpa%252FRC63187_c44f15318cfc8c27de48df5a4beeef3d.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_c44f15318cfc8c27de48df5a4beeef3d.jpg saved to cache
2026-03-30 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37a65657-0884-595c-9188-1906d489adba
2026-03-30 09:07:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37a65657-0884-595c-9188-1906d489adba, skipping ID generation
2026-03-30 09:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37a65657-0884-595c-9188-1906d489adba with scrape type 1
2026-03-30 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37a65657-0884-595c-9188-1906d489adba sending to next pipeline
2026-03-30 09:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 37a65657-0884-595c-9188-1906d489adba, identifier: RC63187
2026-03-30 09:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2563190>
2026-03-30 09:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F09%252F02094e6abd635592ba144e0b50459327%252Fpa%252FXR95165_a5fa78831a6045c8f6559331550c5e0b.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_a5fa78831a6045c8f6559331550c5e0b.jpg saved to cache
2026-03-30 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d628d6c2-6eee-5ba7-bf02-527049a3c587
2026-03-30 09:07:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d628d6c2-6eee-5ba7-bf02-527049a3c587, skipping ID generation
2026-03-30 09:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d628d6c2-6eee-5ba7-bf02-527049a3c587 with scrape type 1
2026-03-30 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d628d6c2-6eee-5ba7-bf02-527049a3c587 sending to next pipeline
2026-03-30 09:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d628d6c2-6eee-5ba7-bf02-527049a3c587, identifier: XR95165
2026-03-30 09:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_9fd1d3f67c4894cf251b1daea4544371.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:13 [auto1.it] INFO: Found listing with ID: YA27479
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA27479%27 HTTP/1.1" 200 None
2026-03-30 09:07:13 [auto1.it] INFO: Scrape type for YA27479: 2
2026-03-30 09:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b5e8054-c882-5daf-9165-d7f8fe5aafa4 with identifier: YA27479
2026-03-30 09:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b5e8054-c882-5daf-9165-d7f8fe5aafa4 with scrape type 2
2026-03-30 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b5e8054-c882-5daf-9165-d7f8fe5aafa4 with scrape type 2
2026-03-30 09:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b5e8054-c882-5daf-9165-d7f8fe5aafa4, identifier: YA27479
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_ccb3a5037af7c92e4c7a23d1aa0eda9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_ccb3a5037af7c92e4c7a23d1aa0eda9f.jpg not downloaded yet
2026-03-30 09:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 37a65657-0884-595c-9188-1906d489adba with identifier: RC63187
2026-03-30 09:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 37a65657-0884-595c-9188-1906d489adba with identifier: RC63187
2026-03-30 09:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 37a65657-0884-595c-9188-1906d489adba with identifier: RC63187 to the API
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_c44f15318cfc8c27de48df5a4beeef3d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 237,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 147,
 'expiration_date': '2026-03-31T15:47:10Z',
 'fuel_type': 'diesel',
 'id': '37a65657-0884-595c-9188-1906d489adba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC63187',
 'listing': 'auction',
 'location': 'IT',
 'make': 'MAXUS',
 'model': 'Deliver 9',
 'odometer': 9661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_0.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 4058345,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_fe265bbe6defd8c80e39643f328600bb.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_c44f15318cfc8c27de48df5a4beeef3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_312f2cf381d261b95b5fe62023249dd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_ae287d3748b06c141e08e6c03877b466.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_b36801e5b95d9de73ced57c3f5d284eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_8417647a8ad30977ff787c2d3c039cbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_7ffc7f984783bf2786491b99ba32fe87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_b5f9c7994aeaa1f00ed4c548278bfc0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_8.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 2818977,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_d1c77c69765ded013b71568629deec8c.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37a65657-0884-595c-9188-1906d489adba/37a65657-0884-595c-9188-1906d489adba_image_9.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 4004998,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/81/ac81686f7b5e6a234b5b7f5ee96f637a/pa/RC63187_225e02c06b4de9b8586e4e51fa2bcea3.jpg',
             'Width': 4032}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 9 2.0 TDCi L3H2 Luxury',
 'transmission': 'manual',
 'trim': 'L3H2 Luxury',
 'year': 2024}
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC63187%27 HTTP/1.1" 200 None
2026-03-30 09:07:13 [auto1.it] INFO: Saving data for RC63187: {'created_time': 1774861633.883631, 'last_price_update_time': 1774861633.883642, 'auction_closing_time': 1774972030.0}
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC63187') HTTP/1.1" 204 0
2026-03-30 09:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d628d6c2-6eee-5ba7-bf02-527049a3c587 with identifier: XR95165
2026-03-30 09:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d628d6c2-6eee-5ba7-bf02-527049a3c587 with identifier: XR95165
2026-03-30 09:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d628d6c2-6eee-5ba7-bf02-527049a3c587 with identifier: XR95165 to the API
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_a5fa78831a6045c8f6559331550c5e0b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:48:33Z',
 'fuel_type': 'gas',
 'id': 'd628d6c2-6eee-5ba7-bf02-527049a3c587',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR95165',
 'listing': 'auction',
 'location': 'IT, Modugno',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 111422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_a5fa78831a6045c8f6559331550c5e0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_13344dc1dfdca722fe792eb99254e82e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_ae043554dcfb42cf39912896caa45d0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_f09e3f2570fb525b5429d41c77428a0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_499f8a3246a4e743b640aacbedb0b1a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_26a3cbb93f86c394a8e7862045402e05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_4e4acb1b71726a7aa5b99a566feca3d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_97f17902b5c8f568b5755580e587fcb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_d6bff64a741ad84227ff3fd4ee4a0308.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d628d6c2-6eee-5ba7-bf02-527049a3c587/d628d6c2-6eee-5ba7-bf02-527049a3c587_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/09/02094e6abd635592ba144e0b50459327/pa/XR95165_cbda28584c1f59e8ae2393eb07aa7d85.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 GPL Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2013}
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR95165%27 HTTP/1.1" 200 None
2026-03-30 09:07:14 [auto1.it] INFO: Saving data for XR95165: {'created_time': 1774861634.355413, 'last_price_update_time': 1774861634.355431, 'auction_closing_time': 1774972113.0}
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XR95165') HTTP/1.1" 204 0
2026-03-30 09:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b5e8054-c882-5daf-9165-d7f8fe5aafa4 with identifier: YA27479
2026-03-30 09:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b5e8054-c882-5daf-9165-d7f8fe5aafa4 with identifier: YA27479
2026-03-30 09:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b5e8054-c882-5daf-9165-d7f8fe5aafa4 with identifier: YA27479 to the API
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-31T15:58:06Z',
 'fuel_type': 'petrol',
 'id': '7b5e8054-c882-5daf-9165-d7f8fe5aafa4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA27479',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 70588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-16',
 'seller_name': None,
 'title': 'MINI Cooper S John Cooper Works Trim',
 'transmission': 'automatic',
 'trim': 'John Cooper Works Trim',
 'year': 2022}
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA27479%27 HTTP/1.1" 200 None
2026-03-30 09:07:14 [auto1.it] INFO: Saving data for YA27479: {'auction_closing_time': 1774972686.0, 'created_time': 1774429600.808793, 'last_price_update_time': 1774861634.71205}
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YA27479') HTTP/1.1" 204 0
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee120a050>
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F39%252Fec395bd2ca48546497652707f1c37105%252Fpa%252FZR86104_cd5a8b106e7a79cf7f20c1391d540799.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_cd5a8b106e7a79cf7f20c1391d540799.jpg saved to cache
2026-03-30 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c
2026-03-30 09:07:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9277cfad-ac07-54b1-8b5d-936d2c021c9c, skipping ID generation
2026-03-30 09:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c with scrape type 1
2026-03-30 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9277cfad-ac07-54b1-8b5d-936d2c021c9c sending to next pipeline
2026-03-30 09:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9277cfad-ac07-54b1-8b5d-936d2c021c9c, identifier: ZR86104
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1296250>
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_34cb8913a61a9670030e40054065eb2f.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_34cb8913a61a9670030e40054065eb2f.jpg saved to cache
2026-03-30 09:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1249690>
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F67%252F5e67bfcd5bb04f6c1d884bec98dc0957%252Fpa%252FPW67312_d7f255bfe3edc5632259522ff948ba8b.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_d7f255bfe3edc5632259522ff948ba8b.jpg saved to cache
2026-03-30 09:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9
2026-03-30 09:07:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b1372ac-a032-5746-aad2-74d6fa5c0be9, skipping ID generation
2026-03-30 09:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9 with scrape type 1
2026-03-30 09:07:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b1372ac-a032-5746-aad2-74d6fa5c0be9 sending to next pipeline
2026-03-30 09:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2b1372ac-a032-5746-aad2-74d6fa5c0be9, identifier: PW67312
2026-03-30 09:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_2a17847e4ab5b9036417596c3f1aa736.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:15 [auto1.it] INFO: Found listing with ID: RA21109
2026-03-30 09:07:15 [auto1.it] INFO: Found listing with ID: NU69507
2026-03-30 09:07:15 [auto1.it] INFO: Found listing with ID: DE35632
2026-03-30 09:07:15 [auto1.it] INFO: Found listing with ID: WE26685
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE26685%27 HTTP/1.1" 200 None
2026-03-30 09:07:15 [auto1.it] INFO: Scrape type for WE26685: 2
2026-03-30 09:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f40180c-db6d-596c-b365-70657ac8494f with identifier: WE26685
2026-03-30 09:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f40180c-db6d-596c-b365-70657ac8494f with scrape type 2
2026-03-30 09:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f40180c-db6d-596c-b365-70657ac8494f with scrape type 2
2026-03-30 09:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6f40180c-db6d-596c-b365-70657ac8494f, identifier: WE26685
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_4d38802a66cce1484536c6a9d48e2806.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_4d38802a66cce1484536c6a9d48e2806.jpg not downloaded yet
2026-03-30 09:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW47560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW23076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9277cfad-ac07-54b1-8b5d-936d2c021c9c with identifier: ZR86104
2026-03-30 09:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9277cfad-ac07-54b1-8b5d-936d2c021c9c with identifier: ZR86104
2026-03-30 09:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9277cfad-ac07-54b1-8b5d-936d2c021c9c with identifier: ZR86104 to the API
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_cd5a8b106e7a79cf7f20c1391d540799.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:28:54Z',
 'fuel_type': 'diesel',
 'id': '9277cfad-ac07-54b1-8b5d-936d2c021c9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR86104',
 'listing': 'auction',
 'location': 'IT, Nola',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 215853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_cd5a8b106e7a79cf7f20c1391d540799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_198e8ee7678617571ff6488586ed0083.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_7871f13b9fb9a64c706f9b3968645e3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_7d6cc0d959c5263fdf946776459d3f1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_62027ba722c45ff52168eb7fe918b297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_0738a7321546a844e90a22f9434ba282.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_74c469f522f7a5d4ad5e5eb13c33d0a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_031015c6a962908fc57d98f1eb916920.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_8af26d2ccb7dcc76d63702ac6c2a88c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9277cfad-ac07-54b1-8b5d-936d2c021c9c/9277cfad-ac07-54b1-8b5d-936d2c021c9c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/39/ec395bd2ca48546497652707f1c37105/pa/ZR86104_56a025e28916b6739155a8554e94ffda.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Active 2WD',
 'transmission': 'manual',
 'trim': 'Active 2WD',
 'year': 2017}
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR86104%27 HTTP/1.1" 200 None
2026-03-30 09:07:15 [auto1.it] INFO: Saving data for ZR86104: {'created_time': 1774861635.658084, 'last_price_update_time': 1774861635.6581, 'auction_closing_time': 1774970934.0}
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR86104') HTTP/1.1" 204 0
2026-03-30 09:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2b1372ac-a032-5746-aad2-74d6fa5c0be9 with identifier: PW67312
2026-03-30 09:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2b1372ac-a032-5746-aad2-74d6fa5c0be9 with identifier: PW67312
2026-03-30 09:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2b1372ac-a032-5746-aad2-74d6fa5c0be9 with identifier: PW67312 to the API
2026-03-30 09:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_d7f255bfe3edc5632259522ff948ba8b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:51:46Z',
 'fuel_type': 'diesel',
 'id': '2b1372ac-a032-5746-aad2-74d6fa5c0be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW67312',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 101250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_3ca64f953c2488bb6fa4632e438e4723.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_34cb8913a61a9670030e40054065eb2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_d7f255bfe3edc5632259522ff948ba8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_10396fad1e0834305dcc39b7f6bf358a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_a638bcea24fec8aa5228d1e29905dc3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_5.png',
             'Extension': 'png',
             'FileSizeInBytes': 879490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_0aa6b1563af19c957f24f2722884374b.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_87246c85c74288931d48d1f6f37acf68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_887eecd57fa29ed777fd76b8e794d074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_6d750b01b6e62613716be1e475a06a2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1372ac-a032-5746-aad2-74d6fa5c0be9/2b1372ac-a032-5746-aad2-74d6fa5c0be9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/67/5e67bfcd5bb04f6c1d884bec98dc0957/pa/PW67312_db5b72acf7e06223fc320c7c39bf34cc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2017}
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW67312%27 HTTP/1.1" 200 None
2026-03-30 09:07:16 [auto1.it] INFO: Saving data for PW67312: {'created_time': 1774861636.290782, 'last_price_update_time': 1774861636.290795, 'auction_closing_time': 1774972306.0}
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW67312') HTTP/1.1" 204 0
2026-03-30 09:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_d05a4570144da7450b88e4197314495a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6f40180c-db6d-596c-b365-70657ac8494f with identifier: WE26685
2026-03-30 09:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6f40180c-db6d-596c-b365-70657ac8494f with identifier: WE26685
2026-03-30 09:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6f40180c-db6d-596c-b365-70657ac8494f with identifier: WE26685 to the API
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:22Z',
 'fuel_type': 'petrol',
 'id': '6f40180c-db6d-596c-b365-70657ac8494f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE26685',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 137332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-22',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2007}
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE26685%27 HTTP/1.1" 200 None
2026-03-30 09:07:16 [auto1.it] INFO: Saving data for WE26685: {'auction_closing_time': 1774971742.0, 'created_time': 1774440346.084291, 'last_price_update_time': 1774861636.637}
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WE26685') HTTP/1.1" 204 0
2026-03-30 09:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24a5cd0>
2026-03-30 09:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_9fd1d3f67c4894cf251b1daea4544371.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_9fd1d3f67c4894cf251b1daea4544371.jpg saved to cache
2026-03-30 09:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5
2026-03-30 09:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_8aefbd8021d3704774d6943c03a3d06e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_1eec34761ceeba8cb08758945e3548eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:16 [auto1.it] INFO: Found listing with ID: ME48508
2026-03-30 09:07:16 [auto1.it] INFO: Found listing with ID: MA55202
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA55202%27 HTTP/1.1" 200 None
2026-03-30 09:07:16 [auto1.it] INFO: Scrape type for MA55202: 2
2026-03-30 09:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eb1f080-1d2a-54a1-b815-bc50a66cd3e2 with identifier: MA55202
2026-03-30 09:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eb1f080-1d2a-54a1-b815-bc50a66cd3e2 with scrape type 2
2026-03-30 09:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eb1f080-1d2a-54a1-b815-bc50a66cd3e2 with scrape type 2
2026-03-30 09:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8eb1f080-1d2a-54a1-b815-bc50a66cd3e2, identifier: MA55202
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_4678ad9eb9a316f24f2d34f14d391864.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_4678ad9eb9a316f24f2d34f14d391864.jpg not downloaded yet
2026-03-30 09:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8eb1f080-1d2a-54a1-b815-bc50a66cd3e2 with identifier: MA55202
2026-03-30 09:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8eb1f080-1d2a-54a1-b815-bc50a66cd3e2 with identifier: MA55202
2026-03-30 09:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8eb1f080-1d2a-54a1-b815-bc50a66cd3e2 with identifier: MA55202 to the API
2026-03-30 09:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:43:46Z',
 'fuel_type': 'diesel',
 'id': '8eb1f080-1d2a-54a1-b815-bc50a66cd3e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA55202',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 148558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-25',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA55202%27 HTTP/1.1" 200 None
2026-03-30 09:07:17 [auto1.it] INFO: Saving data for MA55202: {'auction_closing_time': 1774971826.0, 'created_time': 1774472803.374825, 'last_price_update_time': 1774861637.249112}
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MA55202') HTTP/1.1" 204 0
2026-03-30 09:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ74890> (referer: https://www.auto1.com/v1/car-details-view/RJ74890/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK67266> (referer: https://www.auto1.com/v1/car-details-view/FK67266/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24a4450>
2026-03-30 09:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_2a17847e4ab5b9036417596c3f1aa736.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_2a17847e4ab5b9036417596c3f1aa736.jpg saved to cache
2026-03-30 09:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9
2026-03-30 09:07:17 [auto1.it] INFO: Channel: 24h | Page: 7 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:17 [auto1.it] INFO: Found listing with ID: LV15900
2026-03-30 09:07:17 [auto1.it] INFO: Found listing with ID: NV20276
2026-03-30 09:07:17 [auto1.it] INFO: Found listing with ID: TH12269
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12269%27 HTTP/1.1" 200 None
2026-03-30 09:07:17 [auto1.it] INFO: Scrape type for TH12269: 2
2026-03-30 09:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bf3f333-3cc7-562b-a588-811b80c63bb3 with identifier: TH12269
2026-03-30 09:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf3f333-3cc7-562b-a588-811b80c63bb3 with scrape type 2
2026-03-30 09:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bf3f333-3cc7-562b-a588-811b80c63bb3 with scrape type 2
2026-03-30 09:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7bf3f333-3cc7-562b-a588-811b80c63bb3, identifier: TH12269
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_55cf50d63881e430e724307e92dbc82e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_55cf50d63881e430e724307e92dbc82e.jpg not downloaded yet
2026-03-30 09:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2560c50>
2026-03-30 09:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_d05a4570144da7450b88e4197314495a.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_d05a4570144da7450b88e4197314495a.jpg saved to cache
2026-03-30 09:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5
2026-03-30 09:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_803e57242738d58975cb257de05d40d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_ccb3a5037af7c92e4c7a23d1aa0eda9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7bf3f333-3cc7-562b-a588-811b80c63bb3 with identifier: TH12269
2026-03-30 09:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7bf3f333-3cc7-562b-a588-811b80c63bb3 with identifier: TH12269
2026-03-30 09:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7bf3f333-3cc7-562b-a588-811b80c63bb3 with identifier: TH12269 to the API
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:22:36Z',
 'fuel_type': 'diesel',
 'id': '7bf3f333-3cc7-562b-a588-811b80c63bb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH12269',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 163926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion BlueMotion Tech',
 'year': 2015}
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12269%27 HTTP/1.1" 200 None
2026-03-30 09:07:17 [auto1.it] INFO: Saving data for TH12269: {'auction_closing_time': 1774970556.0, 'created_time': 1774386764.116363, 'last_price_update_time': 1774861637.949303}
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH12269') HTTP/1.1" 204 0
2026-03-30 09:07:17 [auto1.it] INFO: Found listing with ID: EE49908
2026-03-30 09:07:17 [auto1.it] INFO: Found listing with ID: KS95421
2026-03-30 09:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS95421%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for KS95421: 2
2026-03-30 09:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57636142-544f-55c5-bb46-4dec7cc433d8 with identifier: KS95421
2026-03-30 09:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57636142-544f-55c5-bb46-4dec7cc433d8 with scrape type 2
2026-03-30 09:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57636142-544f-55c5-bb46-4dec7cc433d8 with scrape type 2
2026-03-30 09:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57636142-544f-55c5-bb46-4dec7cc433d8, identifier: KS95421
2026-03-30 09:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2786410>
2026-03-30 09:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_8aefbd8021d3704774d6943c03a3d06e.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_8aefbd8021d3704774d6943c03a3d06e.jpg saved to cache
2026-03-30 09:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5
2026-03-30 09:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1254650>
2026-03-30 09:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_1eec34761ceeba8cb08758945e3548eb.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_1eec34761ceeba8cb08758945e3548eb.jpg saved to cache
2026-03-30 09:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5
2026-03-30 09:07:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_54b98688d1d22af48038c5ca19c3f324.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_b3d79139b4c4bc22c196e5accfac8d1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:18 [auto1.it] INFO: Found listing with ID: XV48493
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV48493%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Scrape type for XV48493: 2
2026-03-30 09:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7fa57c4-f8b1-5d6c-8ef2-ceec1f2c0577 with identifier: XV48493
2026-03-30 09:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7fa57c4-f8b1-5d6c-8ef2-ceec1f2c0577 with scrape type 2
2026-03-30 09:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7fa57c4-f8b1-5d6c-8ef2-ceec1f2c0577 with scrape type 2
2026-03-30 09:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7fa57c4-f8b1-5d6c-8ef2-ceec1f2c0577, identifier: XV48493
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_3930e107e8a98ccfb2508dcc2b394b44.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_3930e107e8a98ccfb2508dcc2b394b44.jpg not downloaded yet
2026-03-30 09:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57636142-544f-55c5-bb46-4dec7cc433d8 with identifier: KS95421
2026-03-30 09:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57636142-544f-55c5-bb46-4dec7cc433d8 with identifier: KS95421
2026-03-30 09:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57636142-544f-55c5-bb46-4dec7cc433d8 with identifier: KS95421 to the API
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:03:03Z',
 'fuel_type': 'hybrid',
 'id': '57636142-544f-55c5-bb46-4dec7cc433d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS95421',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 54524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-29',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS95421%27 HTTP/1.1" 200 None
2026-03-30 09:07:18 [auto1.it] INFO: Saving data for KS95421: {'auction_closing_time': 1774969383.0, 'created_time': 1774386514.860284, 'last_price_update_time': 1774861638.92056}
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KS95421') HTTP/1.1" 204 0
2026-03-30 09:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW98785> (referer: https://www.auto1.com/v1/car-details-view/BW98785/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_4d38802a66cce1484536c6a9d48e2806.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7fa57c4-f8b1-5d6c-8ef2-ceec1f2c0577 with identifier: XV48493
2026-03-30 09:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7fa57c4-f8b1-5d6c-8ef2-ceec1f2c0577 with identifier: XV48493
2026-03-30 09:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7fa57c4-f8b1-5d6c-8ef2-ceec1f2c0577 with identifier: XV48493 to the API
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:11:33Z',
 'fuel_type': 'diesel',
 'id': 'b7fa57c4-f8b1-5d6c-8ef2-ceec1f2c0577',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV48493',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 138209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-18',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 M-Jet Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV48493%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Saving data for XV48493: {'auction_closing_time': 1774969893.0, 'created_time': 1774472722.118244, 'last_price_update_time': 1774861639.301534}
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV48493') HTTP/1.1" 204 0
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: DF93704
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF93704%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Scrape type for DF93704: 2
2026-03-30 09:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3f717a8-06a8-59f6-8907-f439f99795b0 with identifier: DF93704
2026-03-30 09:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3f717a8-06a8-59f6-8907-f439f99795b0 with scrape type 2
2026-03-30 09:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3f717a8-06a8-59f6-8907-f439f99795b0 with scrape type 2
2026-03-30 09:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f3f717a8-06a8-59f6-8907-f439f99795b0, identifier: DF93704
2026-03-30 09:07:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ15185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330 with identifier: RJ74890
2026-03-30 09:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330 with scrape type 1
2026-03-30 09:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F82%252F8082c638323a907eab007a71a0125a2c%252Fpa%252FRJ74890_e103fb3208626321a312eaf0b2af9694.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_e103fb3208626321a312eaf0b2af9694.jpg not downloaded yet
2026-03-30 09:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d98c1aa-f077-5c28-94a2-e207e831e674 with identifier: FK67266
2026-03-30 09:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d98c1aa-f077-5c28-94a2-e207e831e674 with scrape type 1
2026-03-30 09:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d98c1aa-f077-5c28-94a2-e207e831e674
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_c6101778e03ebaf463cc3b4a7357bf35.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_c6101778e03ebaf463cc3b4a7357bf35.jpg not downloaded yet
2026-03-30 09:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_00df067aef858d5f609409bd6598e1a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_4678ad9eb9a316f24f2d34f14d391864.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_dd904135a643d4e557a9775580a62629.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_dd904135a643d4e557a9775580a62629.jpg not downloaded yet
2026-03-30 09:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f3f717a8-06a8-59f6-8907-f439f99795b0 with identifier: DF93704
2026-03-30 09:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f3f717a8-06a8-59f6-8907-f439f99795b0 with identifier: DF93704
2026-03-30 09:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f3f717a8-06a8-59f6-8907-f439f99795b0 with identifier: DF93704 to the API
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:40:25Z',
 'fuel_type': 'petrol',
 'id': 'f3f717a8-06a8-59f6-8907-f439f99795b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF93704',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 104234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-16',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2016}
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF93704%27 HTTP/1.1" 200 None
2026-03-30 09:07:19 [auto1.it] INFO: Saving data for DF93704: {'auction_closing_time': 1774971625.0, 'created_time': 1773500726.294422, 'last_price_update_time': 1774861639.938931}
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DF93704') HTTP/1.1" 204 0
2026-03-30 09:07:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:19 [auto1.it] INFO: Found listing with ID: TE47811
2026-03-30 09:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE47811%27 HTTP/1.1" 200 None
2026-03-30 09:07:20 [auto1.it] INFO: Scrape type for TE47811: 2
2026-03-30 09:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da21c6dd-6454-50cf-ab79-754f63439144 with identifier: TE47811
2026-03-30 09:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da21c6dd-6454-50cf-ab79-754f63439144 with scrape type 2
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da21c6dd-6454-50cf-ab79-754f63439144 with scrape type 2
2026-03-30 09:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: da21c6dd-6454-50cf-ab79-754f63439144, identifier: TE47811
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F82%252F8082c638323a907eab007a71a0125a2c%252Fpa%252FRJ74890_6162bf23eb329794aed8360b2c3b9bed.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_6162bf23eb329794aed8360b2c3b9bed.jpg not downloaded yet
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_8e5a13d9f8a971ddeea4fb455d1db3a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_8e5a13d9f8a971ddeea4fb455d1db3a6.jpg not downloaded yet
2026-03-30 09:07:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10abf10>
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_803e57242738d58975cb257de05d40d4.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_803e57242738d58975cb257de05d40d4.jpg saved to cache
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24e2dd0>
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_ccb3a5037af7c92e4c7a23d1aa0eda9f.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_ccb3a5037af7c92e4c7a23d1aa0eda9f.jpg saved to cache
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee287a750>
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F74%252F3674c3df251c7b81ac3fb59ba85350f3%252Fpa%252FYR35596_54b98688d1d22af48038c5ca19c3f324.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_54b98688d1d22af48038c5ca19c3f324.jpg saved to cache
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdab4158-2154-5b1a-9490-057db1962860
2026-03-30 09:07:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdab4158-2154-5b1a-9490-057db1962860, skipping ID generation
2026-03-30 09:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdab4158-2154-5b1a-9490-057db1962860 with scrape type 1
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdab4158-2154-5b1a-9490-057db1962860 sending to next pipeline
2026-03-30 09:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bdab4158-2154-5b1a-9490-057db1962860, identifier: YR35596
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1477a50>
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F97%252Ffb97d97fa36e4c9f2f9c145d86448b26%252Fpa%252FFG27064_b3d79139b4c4bc22c196e5accfac8d1b.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_b3d79139b4c4bc22c196e5accfac8d1b.jpg saved to cache
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aed58a16-af46-53f7-b4dc-119a5bc2b50d
2026-03-30 09:07:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aed58a16-af46-53f7-b4dc-119a5bc2b50d, skipping ID generation
2026-03-30 09:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aed58a16-af46-53f7-b4dc-119a5bc2b50d with scrape type 1
2026-03-30 09:07:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aed58a16-af46-53f7-b4dc-119a5bc2b50d sending to next pipeline
2026-03-30 09:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aed58a16-af46-53f7-b4dc-119a5bc2b50d, identifier: FG27064
2026-03-30 09:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_31e426646110033344cf53b457995b8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: da21c6dd-6454-50cf-ab79-754f63439144 with identifier: TE47811
2026-03-30 09:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: da21c6dd-6454-50cf-ab79-754f63439144 with identifier: TE47811
2026-03-30 09:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: da21c6dd-6454-50cf-ab79-754f63439144 with identifier: TE47811 to the API
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-31T15:29:51Z',
 'fuel_type': 'petrol',
 'id': 'da21c6dd-6454-50cf-ab79-754f63439144',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE47811',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 9602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-03',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 DualJet Mild-Hybrid Top',
 'transmission': 'automatic',
 'trim': 'Top',
 'year': 2024}
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE47811%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Saving data for TE47811: {'auction_closing_time': 1774970991.0, 'created_time': 1774386491.615109, 'last_price_update_time': 1774861641.119242}
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TE47811') HTTP/1.1" 204 0
2026-03-30 09:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bdab4158-2154-5b1a-9490-057db1962860 with identifier: YR35596
2026-03-30 09:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bdab4158-2154-5b1a-9490-057db1962860 with identifier: YR35596
2026-03-30 09:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bdab4158-2154-5b1a-9490-057db1962860 with identifier: YR35596 to the API
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_54b98688d1d22af48038c5ca19c3f324.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:03:14Z',
 'fuel_type': 'diesel',
 'id': 'bdab4158-2154-5b1a-9490-057db1962860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR35596',
 'listing': 'auction',
 'location': 'IT, Agliana (PT)',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 196533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_3de10d132656d25a2322b075fa0fe586.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2806765,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_907f125fcce80a18eb5d4acdcba12d5f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_c997b3372d1c85fd31030e16bb49601c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_8ff8c98a6bd2763c5dba63e9991c851e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_bd5ef8c9794b23ef9ef059ff0eef263d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_96c3c3851e0e7f3d04b1d4b28f5a191a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_c09b20774486d02ddf692bb7020b52f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469684,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_3a7794de5199ead1f3d3689c01910c30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_1550f2326c28980126828a8715b0301c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdab4158-2154-5b1a-9490-057db1962860/bdab4158-2154-5b1a-9490-057db1962860_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/74/3674c3df251c7b81ac3fb59ba85350f3/pa/YR35596_54b98688d1d22af48038c5ca19c3f324.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2013}
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR35596%27 HTTP/1.1" 200 None
2026-03-30 09:07:21 [auto1.it] INFO: Saving data for YR35596: {'created_time': 1774861641.633028, 'last_price_update_time': 1774861641.633043, 'auction_closing_time': 1774969394.0}
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YR35596') HTTP/1.1" 204 0
2026-03-30 09:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aed58a16-af46-53f7-b4dc-119a5bc2b50d with identifier: FG27064
2026-03-30 09:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aed58a16-af46-53f7-b4dc-119a5bc2b50d with identifier: FG27064
2026-03-30 09:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aed58a16-af46-53f7-b4dc-119a5bc2b50d with identifier: FG27064 to the API
2026-03-30 09:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_b3d79139b4c4bc22c196e5accfac8d1b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 202,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 152,
 'expiration_date': '2026-03-31T15:23:41Z',
 'fuel_type': 'petrol',
 'id': 'aed58a16-af46-53f7-b4dc-119a5bc2b50d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG27064',
 'listing': 'auction',
 'location': 'IT, Torino',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 54995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_594ac82f1b38b06c926956517ceee651.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_241890a9d7100599a7447b11f8c16ea8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_76481e8b4f64cb3742ad6f1a45334233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_b3d79139b4c4bc22c196e5accfac8d1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_0398caacea2e7b0de8b92f874fa98963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_114e2adbbc48926ad7345d9bb63d2147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_3994812cc78edca177ea8c637006da6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_5e9aad1dce9a29249d6e4e11f1d11ac6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_68614b3338da950d7ef8f41f091def7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aed58a16-af46-53f7-b4dc-119a5bc2b50d/aed58a16-af46-53f7-b4dc-119a5bc2b50d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/97/fb97d97fa36e4c9f2f9c145d86448b26/pa/FG27064_9f3a591a9c3e2a80fb8c3cb6571e8c24.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG27064%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Saving data for FG27064: {'created_time': 1774861642.166589, 'last_price_update_time': 1774861642.166603, 'auction_closing_time': 1774970621.0}
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FG27064') HTTP/1.1" 204 0
2026-03-30 09:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_ebc6662558b28ed5bef63d75e7c64acb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_b225242088316a5463d34a78ba0fb81f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:22 [auto1.it] INFO: Found listing with ID: GE96866
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE96866%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [auto1.it] INFO: Scrape type for GE96866: 2
2026-03-30 09:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54e56fb2-2254-5888-91d9-e71650159dc1 with identifier: GE96866
2026-03-30 09:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54e56fb2-2254-5888-91d9-e71650159dc1 with scrape type 2
2026-03-30 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54e56fb2-2254-5888-91d9-e71650159dc1 with scrape type 2
2026-03-30 09:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54e56fb2-2254-5888-91d9-e71650159dc1, identifier: GE96866
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F82%252F8082c638323a907eab007a71a0125a2c%252Fpa%252FRJ74890_e4b51390397fb825d81fe677aa661dca.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_e4b51390397fb825d81fe677aa661dca.jpg not downloaded yet
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_2d1413bf8bbd43d707bd41f7debc5fb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_2d1413bf8bbd43d707bd41f7debc5fb7.jpg not downloaded yet
2026-03-30 09:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffb76fe2-156f-5adc-b14e-9da41f16948e with identifier: BW98785
2026-03-30 09:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb76fe2-156f-5adc-b14e-9da41f16948e with scrape type 1
2026-03-30 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffb76fe2-156f-5adc-b14e-9da41f16948e
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_e452fddba8f1f3d22b819e39131d6de2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e452fddba8f1f3d22b819e39131d6de2.jpg not downloaded yet
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24acc10>
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_4d38802a66cce1484536c6a9d48e2806.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_4d38802a66cce1484536c6a9d48e2806.jpg saved to cache
2026-03-30 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1325150>
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_00df067aef858d5f609409bd6598e1a6.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_00df067aef858d5f609409bd6598e1a6.jpg saved to cache
2026-03-30 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1449d10>
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_4678ad9eb9a316f24f2d34f14d391864.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_4678ad9eb9a316f24f2d34f14d391864.jpg saved to cache
2026-03-30 09:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5
2026-03-30 09:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_3930e107e8a98ccfb2508dcc2b394b44.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_a1f15c9f27e0a484ac53af197eb68df1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_dbb661579cc2d931f568090eff81afbc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_55cf50d63881e430e724307e92dbc82e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54e56fb2-2254-5888-91d9-e71650159dc1 with identifier: GE96866
2026-03-30 09:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54e56fb2-2254-5888-91d9-e71650159dc1 with identifier: GE96866
2026-03-30 09:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54e56fb2-2254-5888-91d9-e71650159dc1 with identifier: GE96866 to the API
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:47:15Z',
 'fuel_type': 'diesel',
 'id': '54e56fb2-2254-5888-91d9-e71650159dc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE96866',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 20486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-04',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Shooting Brake 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE96866%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Saving data for GE96866: {'auction_closing_time': 1774972035.0, 'created_time': 1773695321.196445, 'last_price_update_time': 1774861643.066557}
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GE96866') HTTP/1.1" 204 0
2026-03-30 09:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU05925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: LK09614
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: HU36164
2026-03-30 09:07:23 [auto1.it] INFO: Found listing with ID: GR02262
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR02262%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Scrape type for GR02262: 2
2026-03-30 09:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50684cb7-8f9e-56c4-a358-a99fab64501f with identifier: GR02262
2026-03-30 09:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50684cb7-8f9e-56c4-a358-a99fab64501f with scrape type 2
2026-03-30 09:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50684cb7-8f9e-56c4-a358-a99fab64501f with scrape type 2
2026-03-30 09:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 50684cb7-8f9e-56c4-a358-a99fab64501f, identifier: GR02262
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F82%252F8082c638323a907eab007a71a0125a2c%252Fpa%252FRJ74890_cc8017b2fa91ecf20f9fd309dd98bf83.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_cc8017b2fa91ecf20f9fd309dd98bf83.jpg not downloaded yet
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_7450d497a3086031a703790e3d24a255.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_7450d497a3086031a703790e3d24a255.jpg not downloaded yet
2026-03-30 09:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_848d36fa96ed36e9d5493fc08b698f3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_848d36fa96ed36e9d5493fc08b698f3a.jpg not downloaded yet
2026-03-30 09:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF93411/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RP34917> (referer: https://www.auto1.com/v1/car-details-view/RP34917/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB21733> (referer: https://www.auto1.com/v1/car-details-view/KB21733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13f12d0>
2026-03-30 09:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_31e426646110033344cf53b457995b8d.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_31e426646110033344cf53b457995b8d.jpg saved to cache
2026-03-30 09:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9
2026-03-30 09:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 50684cb7-8f9e-56c4-a358-a99fab64501f with identifier: GR02262
2026-03-30 09:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 50684cb7-8f9e-56c4-a358-a99fab64501f with identifier: GR02262
2026-03-30 09:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 50684cb7-8f9e-56c4-a358-a99fab64501f with identifier: GR02262 to the API
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:06:18Z',
 'fuel_type': 'diesel',
 'id': '50684cb7-8f9e-56c4-a358-a99fab64501f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR02262',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 216005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-26',
 'seller_name': None,
 'title': 'Volvo V50 1.6 D2 Polar Plus',
 'transmission': 'manual',
 'trim': 'Polar Plus',
 'year': 2012}
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR02262%27 HTTP/1.1" 200 None
2026-03-30 09:07:23 [auto1.it] INFO: Saving data for GR02262: {'auction_closing_time': 1774969578.0, 'created_time': 1774440392.031733, 'last_price_update_time': 1774861643.912283}
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GR02262') HTTP/1.1" 204 0
2026-03-30 09:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1275750>
2026-03-30 09:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fc3%252F41c399cebfc77daa28a9c0ee91cef34c%252Fpa%252FMZ19465_ebc6662558b28ed5bef63d75e7c64acb.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_ebc6662558b28ed5bef63d75e7c64acb.jpg saved to cache
2026-03-30 09:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9
2026-03-30 09:07:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa08c143-7fe0-527b-ac6a-fcb3be1e10e9, skipping ID generation
2026-03-30 09:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9 with scrape type 1
2026-03-30 09:07:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa08c143-7fe0-527b-ac6a-fcb3be1e10e9 sending to next pipeline
2026-03-30 09:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa08c143-7fe0-527b-ac6a-fcb3be1e10e9, identifier: MZ19465
2026-03-30 09:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee144a210>
2026-03-30 09:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F23%252F132363d269e97a3bd0313f50fc86f15d%252Fpa%252FTT31796_b225242088316a5463d34a78ba0fb81f.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_b225242088316a5463d34a78ba0fb81f.jpg saved to cache
2026-03-30 09:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8513602-c95f-5916-a9c6-6b1300653209
2026-03-30 09:07:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8513602-c95f-5916-a9c6-6b1300653209, skipping ID generation
2026-03-30 09:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8513602-c95f-5916-a9c6-6b1300653209 with scrape type 1
2026-03-30 09:07:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8513602-c95f-5916-a9c6-6b1300653209 sending to next pipeline
2026-03-30 09:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8513602-c95f-5916-a9c6-6b1300653209, identifier: TT31796
2026-03-30 09:07:24 [auto1.it] INFO: Found listing with ID: DS64702
2026-03-30 09:07:24 [auto1.it] INFO: Found listing with ID: PF04390
2026-03-30 09:07:24 [auto1.it] INFO: Found listing with ID: YX59353
2026-03-30 09:07:24 [auto1.it] INFO: Found listing with ID: MY23497
2026-03-30 09:07:24 [auto1.it] INFO: Found listing with ID: WL38186
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL38186%27 HTTP/1.1" 200 None
2026-03-30 09:07:24 [auto1.it] INFO: Scrape type for WL38186: 2
2026-03-30 09:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfe38cd0-4979-55ab-9aaa-e60219507e83 with identifier: WL38186
2026-03-30 09:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfe38cd0-4979-55ab-9aaa-e60219507e83 with scrape type 2
2026-03-30 09:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfe38cd0-4979-55ab-9aaa-e60219507e83 with scrape type 2
2026-03-30 09:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bfe38cd0-4979-55ab-9aaa-e60219507e83, identifier: WL38186
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F82%252F8082c638323a907eab007a71a0125a2c%252Fpa%252FRJ74890_2fa0cd33a347676269579fa85ba33a4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_2fa0cd33a347676269579fa85ba33a4c.jpg not downloaded yet
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_d60e39ecd3243c4e82acfb10103eae39.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_d60e39ecd3243c4e82acfb10103eae39.jpg not downloaded yet
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_9a6d10d0a4579d48277169cac5a3508b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_9a6d10d0a4579d48277169cac5a3508b.jpg not downloaded yet
2026-03-30 09:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa08c143-7fe0-527b-ac6a-fcb3be1e10e9 with identifier: MZ19465
2026-03-30 09:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa08c143-7fe0-527b-ac6a-fcb3be1e10e9 with identifier: MZ19465
2026-03-30 09:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa08c143-7fe0-527b-ac6a-fcb3be1e10e9 with identifier: MZ19465 to the API
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_ebc6662558b28ed5bef63d75e7c64acb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:01:44Z',
 'fuel_type': 'diesel',
 'id': 'aa08c143-7fe0-527b-ac6a-fcb3be1e10e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ19465',
 'listing': 'auction',
 'location': 'IT, Cinisello Balsamo',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 223462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_fa17bd822d9582b364b5dbc7445ec489.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624982,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_2a17847e4ab5b9036417596c3f1aa736.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_d5a6f994362b452b5ca2b94e31e256d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2654121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_803e57242738d58975cb257de05d40d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_eeb427707c95278a9e484823d1177e4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_c85ca4100c00d5cb260858ab52d62f18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585186,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_31e426646110033344cf53b457995b8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_71b3fc42e720d82573d4f58f88fbbd7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_f1e577ca481ced93f3786a9336ee1417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa08c143-7fe0-527b-ac6a-fcb3be1e10e9/aa08c143-7fe0-527b-ac6a-fcb3be1e10e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2681281,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/c3/41c399cebfc77daa28a9c0ee91cef34c/pa/MZ19465_ebc6662558b28ed5bef63d75e7c64acb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-13',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Shine M',
 'transmission': 'automatic',
 'trim': 'Shine M',
 'year': 2017}
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ19465%27 HTTP/1.1" 200 None
2026-03-30 09:07:25 [auto1.it] INFO: Saving data for MZ19465: {'created_time': 1774861645.05007, 'last_price_update_time': 1774861645.05008, 'auction_closing_time': 1774969304.0}
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MZ19465') HTTP/1.1" 204 0
2026-03-30 09:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8513602-c95f-5916-a9c6-6b1300653209 with identifier: TT31796
2026-03-30 09:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8513602-c95f-5916-a9c6-6b1300653209 with identifier: TT31796
2026-03-30 09:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8513602-c95f-5916-a9c6-6b1300653209 with identifier: TT31796 to the API
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_b225242088316a5463d34a78ba0fb81f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:11:47Z',
 'fuel_type': 'petrol',
 'id': 'd8513602-c95f-5916-a9c6-6b1300653209',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT31796',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 226285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_016271e77155e44f9a5539509d9d97b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_787328264bd7713a65801f13a32358f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_b225242088316a5463d34a78ba0fb81f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_e8d7e8ffc12226e8cffc5883a9176e34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_59586913942965f1f1900df91f30fcae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_6c83138e5e98192eb039417032c7aaf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_3621977bad8ee073e8f76fad982060f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_22d401e1acfe3bbf62fdf6d96a85322e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_68ee6a4edcd49c57abf4ce083f31d8d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8513602-c95f-5916-a9c6-6b1300653209/d8513602-c95f-5916-a9c6-6b1300653209_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/23/132363d269e97a3bd0313f50fc86f15d/pa/TT31796_47af5056d755d4be911e3265b7013a62.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT31796%27 HTTP/1.1" 200 None
2026-03-30 09:07:25 [auto1.it] INFO: Saving data for TT31796: {'created_time': 1774861645.514201, 'last_price_update_time': 1774861645.514212, 'auction_closing_time': 1774969907.0}
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TT31796') HTTP/1.1" 204 0
2026-03-30 09:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bfe38cd0-4979-55ab-9aaa-e60219507e83 with identifier: WL38186
2026-03-30 09:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bfe38cd0-4979-55ab-9aaa-e60219507e83 with identifier: WL38186
2026-03-30 09:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bfe38cd0-4979-55ab-9aaa-e60219507e83 with identifier: WL38186 to the API
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:34:05Z',
 'fuel_type': 'diesel',
 'id': 'bfe38cd0-4979-55ab-9aaa-e60219507e83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL38186',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 167993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-15',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL38186%27 HTTP/1.1" 200 None
2026-03-30 09:07:25 [auto1.it] INFO: Saving data for WL38186: {'auction_closing_time': 1774971245.0, 'created_time': 1774041037.088925, 'last_price_update_time': 1774861645.919405}
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WL38186') HTTP/1.1" 204 0
2026-03-30 09:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee263c510>
2026-03-30 09:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_3930e107e8a98ccfb2508dcc2b394b44.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_3930e107e8a98ccfb2508dcc2b394b44.jpg saved to cache
2026-03-30 09:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5
2026-03-30 09:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee254e810>
2026-03-30 09:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F75%252F3c75e658c72f24d785a1ecee17da36df%252Fpa%252FWR11304_a1f15c9f27e0a484ac53af197eb68df1.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_a1f15c9f27e0a484ac53af197eb68df1.jpg saved to cache
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-03-30 09:07:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bebe1cb8-2a61-5114-9ba1-2c25ccb03698, skipping ID generation
2026-03-30 09:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with scrape type 1
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698 sending to next pipeline
2026-03-30 09:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bebe1cb8-2a61-5114-9ba1-2c25ccb03698, identifier: WR11304
2026-03-30 09:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee144ac50>
2026-03-30 09:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e60e8b2c-2ddc-5c21-8df5-23eca2c90987/e60e8b2c-2ddc-5c21-8df5-23eca2c90987_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F5a%252F2b5ab3fe722ec37ff8b79bc748e4bbce%252Fpa%252FFD34465_dbb661579cc2d931f568090eff81afbc.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_dbb661579cc2d931f568090eff81afbc.jpg saved to cache
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e60e8b2c-2ddc-5c21-8df5-23eca2c90987
2026-03-30 09:07:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e60e8b2c-2ddc-5c21-8df5-23eca2c90987, skipping ID generation
2026-03-30 09:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e60e8b2c-2ddc-5c21-8df5-23eca2c90987 with scrape type 1
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e60e8b2c-2ddc-5c21-8df5-23eca2c90987 sending to next pipeline
2026-03-30 09:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e60e8b2c-2ddc-5c21-8df5-23eca2c90987, identifier: FD34465
2026-03-30 09:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24e3250>
2026-03-30 09:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_55cf50d63881e430e724307e92dbc82e.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_55cf50d63881e430e724307e92dbc82e.jpg saved to cache
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5
2026-03-30 09:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9 with identifier: RP34917
2026-03-30 09:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9 with scrape type 1
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5b%252Fa85bc7415191c842746e57db8f5238e3%252Fpa%252FRP34917_ece037bbdc2798d6ddfdebec80a841e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_ece037bbdc2798d6ddfdebec80a841e4.jpg not downloaded yet
2026-03-30 09:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afbb5720-7505-50aa-8f4a-f5590cc13331 with identifier: KB21733
2026-03-30 09:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afbb5720-7505-50aa-8f4a-f5590cc13331 with scrape type 1
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item afbb5720-7505-50aa-8f4a-f5590cc13331
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_d9069787cfe356422f06a66e66e4f9e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_d9069787cfe356422f06a66e66e4f9e5.jpg not downloaded yet
2026-03-30 09:07:26 [auto1.it] INFO: Found listing with ID: RX09361
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX09361%27 HTTP/1.1" 200 None
2026-03-30 09:07:26 [auto1.it] INFO: Scrape type for RX09361: 2
2026-03-30 09:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6a1804d-b39a-5ac7-a864-110db5eba087 with identifier: RX09361
2026-03-30 09:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6a1804d-b39a-5ac7-a864-110db5eba087 with scrape type 2
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6a1804d-b39a-5ac7-a864-110db5eba087 with scrape type 2
2026-03-30 09:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e6a1804d-b39a-5ac7-a864-110db5eba087, identifier: RX09361
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_81de64171288e458f7fda6fb2f0fe993.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_81de64171288e458f7fda6fb2f0fe993.jpg not downloaded yet
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_414888cc1f5c647e376220257e86729a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_414888cc1f5c647e376220257e86729a.jpg not downloaded yet
2026-03-30 09:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV17911> (referer: https://www.auto1.com/v1/car-details-view/YV17911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with identifier: WR11304
2026-03-30 09:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with identifier: WR11304
2026-03-30 09:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with identifier: WR11304 to the API
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_a1f15c9f27e0a484ac53af197eb68df1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:08:36Z',
 'fuel_type': 'diesel',
 'id': 'bebe1cb8-2a61-5114-9ba1-2c25ccb03698',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR11304',
 'listing': 'auction',
 'location': 'IT, Corte Stanghellini (Capannori)',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 59330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fd601fdc16f7532675122535e7ba4976.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_5416ee22654ba5758a9235dffbb8e4d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_b4b28c4786c55e8ee3fa5ccb3f8a8b76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_a1f15c9f27e0a484ac53af197eb68df1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fc3dcb4b993cbd7a7725571f23231f2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_00df067aef858d5f609409bd6598e1a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_1b92cc4bb7073f64caa86851198af20c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_f793f1d9f08f92e3d87e5af6c0faa8e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_774e36b5a1ef9c2d6275ae193fc1ad8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_89acf8fc33056768cc57993ad2cb56e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2021}
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR11304%27 HTTP/1.1" 200 None
2026-03-30 09:07:26 [auto1.it] INFO: Saving data for WR11304: {'created_time': 1774861646.971719, 'last_price_update_time': 1774861646.971728, 'auction_closing_time': 1774969716.0}
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WR11304') HTTP/1.1" 204 0
2026-03-30 09:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e60e8b2c-2ddc-5c21-8df5-23eca2c90987 with identifier: FD34465
2026-03-30 09:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e60e8b2c-2ddc-5c21-8df5-23eca2c90987 with identifier: FD34465
2026-03-30 09:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e60e8b2c-2ddc-5c21-8df5-23eca2c90987 with identifier: FD34465 to the API
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_dbb661579cc2d931f568090eff81afbc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:37:04Z',
 'fuel_type': 'petrol',
 'id': 'e60e8b2c-2ddc-5c21-8df5-23eca2c90987',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD34465',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 131899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e60e8b2c-2ddc-5c21-8df5-23eca2c90987/e60e8b2c-2ddc-5c21-8df5-23eca2c90987_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_c3214bef7539559152dbeabf758ab83b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e60e8b2c-2ddc-5c21-8df5-23eca2c90987/e60e8b2c-2ddc-5c21-8df5-23eca2c90987_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_04b914f1565507f088c49019fe4ad838.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e60e8b2c-2ddc-5c21-8df5-23eca2c90987/e60e8b2c-2ddc-5c21-8df5-23eca2c90987_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_dbb661579cc2d931f568090eff81afbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e60e8b2c-2ddc-5c21-8df5-23eca2c90987/e60e8b2c-2ddc-5c21-8df5-23eca2c90987_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_9feb29b715798457fb1be5fd3e6f2068.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e60e8b2c-2ddc-5c21-8df5-23eca2c90987/e60e8b2c-2ddc-5c21-8df5-23eca2c90987_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/5a/2b5ab3fe722ec37ff8b79bc748e4bbce/pa/FD34465_956210d09addecacee8e76e6c16b69c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD34465%27 HTTP/1.1" 200 None
2026-03-30 09:07:27 [auto1.it] INFO: Saving data for FD34465: {'created_time': 1774861647.41467, 'last_price_update_time': 1774861647.414682, 'auction_closing_time': 1774971424.0}
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FD34465') HTTP/1.1" 204 0
2026-03-30 09:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e6a1804d-b39a-5ac7-a864-110db5eba087 with identifier: RX09361
2026-03-30 09:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e6a1804d-b39a-5ac7-a864-110db5eba087 with identifier: RX09361
2026-03-30 09:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e6a1804d-b39a-5ac7-a864-110db5eba087 with identifier: RX09361 to the API
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:13:48Z',
 'fuel_type': 'diesel',
 'id': 'e6a1804d-b39a-5ac7-a864-110db5eba087',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX09361',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 197763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-25',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Line BlueMotion Tech.',
 'transmission': 'automatic',
 'trim': 'Business Line BlueMotion Tech.',
 'year': 2019}
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX09361%27 HTTP/1.1" 200 None
2026-03-30 09:07:27 [auto1.it] INFO: Saving data for RX09361: {'auction_closing_time': 1774970028.0, 'created_time': 1774361274.883099, 'last_price_update_time': 1774861647.796654}
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX09361') HTTP/1.1" 204 0
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5b%252Fa85bc7415191c842746e57db8f5238e3%252Fpa%252FRP34917_72a9b0c4bfb9e6a526c11e364bda2f3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_72a9b0c4bfb9e6a526c11e364bda2f3c.jpg not downloaded yet
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_1a575d2453db8e583aae55b26cca27e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_1a575d2453db8e583aae55b26cca27e8.jpg not downloaded yet
2026-03-30 09:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW23076> (referer: https://www.auto1.com/v1/car-details-view/CW23076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:27 [auto1.it] INFO: Found listing with ID: XR03197
2026-03-30 09:07:27 [auto1.it] INFO: Found listing with ID: JT52337
2026-03-30 09:07:27 [auto1.it] INFO: Found listing with ID: LF83969
2026-03-30 09:07:27 [auto1.it] INFO: Found listing with ID: SJ27084
2026-03-30 09:07:27 [auto1.it] INFO: Found listing with ID: GA52227
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA52227%27 HTTP/1.1" 200 None
2026-03-30 09:07:27 [auto1.it] INFO: Scrape type for GA52227: 2
2026-03-30 09:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2961e436-2bac-5c36-b3da-6bbb313319e5 with identifier: GA52227
2026-03-30 09:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2961e436-2bac-5c36-b3da-6bbb313319e5 with scrape type 2
2026-03-30 09:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2961e436-2bac-5c36-b3da-6bbb313319e5 with scrape type 2
2026-03-30 09:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2961e436-2bac-5c36-b3da-6bbb313319e5, identifier: GA52227
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_5affe906167f6d024a902ce08af59642.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_5affe906167f6d024a902ce08af59642.jpg not downloaded yet
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_08709293e03908babaa1925aa56a2c61.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_08709293e03908babaa1925aa56a2c61.jpg not downloaded yet
2026-03-30 09:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2961e436-2bac-5c36-b3da-6bbb313319e5 with identifier: GA52227
2026-03-30 09:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2961e436-2bac-5c36-b3da-6bbb313319e5 with identifier: GA52227
2026-03-30 09:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2961e436-2bac-5c36-b3da-6bbb313319e5 with identifier: GA52227 to the API
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:20:21Z',
 'fuel_type': 'diesel',
 'id': '2961e436-2bac-5c36-b3da-6bbb313319e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA52227',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 75717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA52227%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Saving data for GA52227: {'auction_closing_time': 1774970421.0, 'created_time': 1774472990.190514, 'last_price_update_time': 1774861648.474658}
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GA52227') HTTP/1.1" 204 0
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5b%252Fa85bc7415191c842746e57db8f5238e3%252Fpa%252FRP34917_fe991f5b7184683f25bb4b705d568a5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_fe991f5b7184683f25bb4b705d568a5a.jpg not downloaded yet
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_072e4ba8800bf1360a8db1c1ed2e80a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_072e4ba8800bf1360a8db1c1ed2e80a8.jpg not downloaded yet
2026-03-30 09:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW47560> (referer: https://www.auto1.com/v1/car-details-view/DW47560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:28 [auto1.it] INFO: Channel: 24h | Page: 8 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6f2111c-ca9f-5633-834a-ea798b46fabd with identifier: YV17911
2026-03-30 09:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f2111c-ca9f-5633-834a-ea798b46fabd with scrape type 1
2026-03-30 09:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6f2111c-ca9f-5633-834a-ea798b46fabd
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_c4dc4733e408d5d7f0c5e9572ae1d368.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_c4dc4733e408d5d7f0c5e9572ae1d368.jpg not downloaded yet
2026-03-30 09:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_d60e39ecd3243c4e82acfb10103eae39.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_7450d497a3086031a703790e3d24a255.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_9a6d10d0a4579d48277169cac5a3508b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_2d1413bf8bbd43d707bd41f7debc5fb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: DS88092
2026-03-30 09:07:28 [auto1.it] INFO: Found listing with ID: KC09537
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC09537%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [auto1.it] INFO: Scrape type for KC09537: 2
2026-03-30 09:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e590790f-698b-5fdf-b8d9-e286116a769f with identifier: KC09537
2026-03-30 09:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e590790f-698b-5fdf-b8d9-e286116a769f with scrape type 2
2026-03-30 09:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e590790f-698b-5fdf-b8d9-e286116a769f with scrape type 2
2026-03-30 09:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e590790f-698b-5fdf-b8d9-e286116a769f, identifier: KC09537
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_f4835b2db4683e8fe3406874ebdf6020.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_f4835b2db4683e8fe3406874ebdf6020.jpg not downloaded yet
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_c0f3add9a7976b3b7bfe708ec9172fb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_c0f3add9a7976b3b7bfe708ec9172fb4.jpg not downloaded yet
2026-03-30 09:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_2fa0cd33a347676269579fa85ba33a4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e452fddba8f1f3d22b819e39131d6de2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_cc8017b2fa91ecf20f9fd309dd98bf83.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_848d36fa96ed36e9d5493fc08b698f3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e590790f-698b-5fdf-b8d9-e286116a769f with identifier: KC09537
2026-03-30 09:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e590790f-698b-5fdf-b8d9-e286116a769f with identifier: KC09537
2026-03-30 09:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e590790f-698b-5fdf-b8d9-e286116a769f with identifier: KC09537 to the API
2026-03-30 09:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:30:04Z',
 'fuel_type': 'diesel',
 'id': 'e590790f-698b-5fdf-b8d9-e286116a769f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC09537',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 75206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-16',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 HDi Seduction',
 'transmission': 'automatic',
 'trim': 'Seduction',
 'year': 2013}
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC09537%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [auto1.it] INFO: Saving data for KC09537: {'auction_closing_time': 1774971004.0, 'created_time': 1774386750.960572, 'last_price_update_time': 1774861649.213169}
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC09537') HTTP/1.1" 204 0
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5b%252Fa85bc7415191c842746e57db8f5238e3%252Fpa%252FRP34917_bda00fa9740fba6628788292cfe6b366.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_bda00fa9740fba6628788292cfe6b366.jpg not downloaded yet
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_334766e9e5c878309c08158cc838bf06.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_334766e9e5c878309c08158cc838bf06.jpg not downloaded yet
2026-03-30 09:07:29 [auto1.it] INFO: Found listing with ID: DG05029
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG05029%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [auto1.it] INFO: Scrape type for DG05029: 2
2026-03-30 09:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 145d5806-f95a-598f-9905-96530266e6a6 with identifier: DG05029
2026-03-30 09:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 145d5806-f95a-598f-9905-96530266e6a6 with scrape type 2
2026-03-30 09:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 145d5806-f95a-598f-9905-96530266e6a6 with scrape type 2
2026-03-30 09:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 145d5806-f95a-598f-9905-96530266e6a6, identifier: DG05029
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_77bbf7941175868b43f2124a7ce34030.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_77bbf7941175868b43f2124a7ce34030.jpg not downloaded yet
2026-03-30 09:07:29 [auto1.it] INFO: Found listing with ID: KU76175
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU76175%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [auto1.it] INFO: Scrape type for KU76175: 2
2026-03-30 09:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6a08176-b56c-51f3-8e7a-5c88ed940e34 with identifier: KU76175
2026-03-30 09:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a08176-b56c-51f3-8e7a-5c88ed940e34 with scrape type 2
2026-03-30 09:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6a08176-b56c-51f3-8e7a-5c88ed940e34 with scrape type 2
2026-03-30 09:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6a08176-b56c-51f3-8e7a-5c88ed940e34, identifier: KU76175
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_94d7687a5c30202bf26d564113eee8ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_94d7687a5c30202bf26d564113eee8ab.jpg not downloaded yet
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_69d3adba9cf18e4abb0c620d70785426.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_69d3adba9cf18e4abb0c620d70785426.jpg not downloaded yet
2026-03-30 09:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 145d5806-f95a-598f-9905-96530266e6a6 with identifier: DG05029
2026-03-30 09:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 145d5806-f95a-598f-9905-96530266e6a6 with identifier: DG05029
2026-03-30 09:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 145d5806-f95a-598f-9905-96530266e6a6 with identifier: DG05029 to the API
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:46:51Z',
 'fuel_type': 'diesel',
 'id': '145d5806-f95a-598f-9905-96530266e6a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG05029',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 154654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI CrossPolo BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cross BlueMotion Tech',
 'year': 2016}
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG05029%27 HTTP/1.1" 200 None
2026-03-30 09:07:29 [auto1.it] INFO: Saving data for DG05029: {'auction_closing_time': 1774972011.0, 'created_time': 1774343292.248676, 'last_price_update_time': 1774861649.952951}
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DG05029') HTTP/1.1" 204 0
2026-03-30 09:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21c6d778-d381-54d0-8677-1db7cd23fbba with identifier: CW23076
2026-03-30 09:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21c6d778-d381-54d0-8677-1db7cd23fbba with scrape type 1
2026-03-30 09:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21c6d778-d381-54d0-8677-1db7cd23fbba
2026-03-30 09:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_65f774dd6a4dbc1c6666bf276cd1c39e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_65f774dd6a4dbc1c6666bf276cd1c39e.jpg not downloaded yet
2026-03-30 09:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6a08176-b56c-51f3-8e7a-5c88ed940e34 with identifier: KU76175
2026-03-30 09:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6a08176-b56c-51f3-8e7a-5c88ed940e34 with identifier: KU76175
2026-03-30 09:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6a08176-b56c-51f3-8e7a-5c88ed940e34 with identifier: KU76175 to the API
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:54:46Z',
 'fuel_type': 'gas',
 'id': 'a6a08176-b56c-51f3-8e7a-5c88ed940e34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU76175',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 44854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-11',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Extreme Up',
 'transmission': 'manual',
 'trim': 'Extreme Up',
 'year': 2022}
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU76175%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Saving data for KU76175: {'auction_closing_time': 1774972486.0, 'created_time': 1774473028.430831, 'last_price_update_time': 1774861650.430736}
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KU76175') HTTP/1.1" 204 0
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5b%252Fa85bc7415191c842746e57db8f5238e3%252Fpa%252FRP34917_4919f112480e577ffb496da129a02e43.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_4919f112480e577ffb496da129a02e43.jpg not downloaded yet
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_ad2abce50ade4f1ac8d0d12f50981c0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_ad2abce50ade4f1ac8d0d12f50981c0d.jpg not downloaded yet
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: SB43927
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: PV19108
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV19108%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for PV19108: 2
2026-03-30 09:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d169419-8d7e-5c09-88da-ba121e6bfc90 with identifier: PV19108
2026-03-30 09:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d169419-8d7e-5c09-88da-ba121e6bfc90 with scrape type 2
2026-03-30 09:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d169419-8d7e-5c09-88da-ba121e6bfc90 with scrape type 2
2026-03-30 09:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8d169419-8d7e-5c09-88da-ba121e6bfc90, identifier: PV19108
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_dd5a6b138598bf7f26cc485c42dbabc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_dd5a6b138598bf7f26cc485c42dbabc0.jpg not downloaded yet
2026-03-30 09:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW32826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_e4b51390397fb825d81fe677aa661dca.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_d9069787cfe356422f06a66e66e4f9e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_ece037bbdc2798d6ddfdebec80a841e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_8e5a13d9f8a971ddeea4fb455d1db3a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: NY59521
2026-03-30 09:07:30 [auto1.it] INFO: Found listing with ID: ZT54121
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT54121%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [auto1.it] INFO: Scrape type for ZT54121: 1
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_f29223f5c034e9023f906b355ba9c6bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_f29223f5c034e9023f906b355ba9c6bb.jpg not downloaded yet
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_c3b424fe45a51a2a9754236183e14caf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_c3b424fe45a51a2a9754236183e14caf.jpg not downloaded yet
2026-03-30 09:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8d169419-8d7e-5c09-88da-ba121e6bfc90 with identifier: PV19108
2026-03-30 09:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8d169419-8d7e-5c09-88da-ba121e6bfc90 with identifier: PV19108
2026-03-30 09:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8d169419-8d7e-5c09-88da-ba121e6bfc90 with identifier: PV19108 to the API
2026-03-30 09:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:32:09Z',
 'fuel_type': 'petrol',
 'id': '8d169419-8d7e-5c09-88da-ba121e6bfc90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV19108',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 99802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV19108%27 HTTP/1.1" 200 None
2026-03-30 09:07:31 [auto1.it] INFO: Saving data for PV19108: {'auction_closing_time': 1774971129.0, 'created_time': 1773231654.535857, 'last_price_update_time': 1774861651.54445}
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV19108') HTTP/1.1" 204 0
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_8beea7e9a8330c5c6d6bb28b328c8b6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_8beea7e9a8330c5c6d6bb28b328c8b6d.jpg not downloaded yet
2026-03-30 09:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_5affe906167f6d024a902ce08af59642.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_4bec2271ba2036d36d3fc6be0ce3608a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_4bec2271ba2036d36d3fc6be0ce3608a.jpg not downloaded yet
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: RT37203
2026-03-30 09:07:31 [auto1.it] INFO: Found listing with ID: DW74662
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW74662%27 HTTP/1.1" 200 None
2026-03-30 09:07:31 [auto1.it] INFO: Scrape type for DW74662: 2
2026-03-30 09:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a84a589-6a6c-54d9-971a-3feae306d508 with identifier: DW74662
2026-03-30 09:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a84a589-6a6c-54d9-971a-3feae306d508 with scrape type 2
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a84a589-6a6c-54d9-971a-3feae306d508 with scrape type 2
2026-03-30 09:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a84a589-6a6c-54d9-971a-3feae306d508, identifier: DW74662
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_1bdd266db3bf9133fcfe6c06276ae0ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_1bdd266db3bf9133fcfe6c06276ae0ce.jpg not downloaded yet
2026-03-30 09:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f619023c-88a6-5aa9-929a-dbec344354a8 with identifier: DW47560
2026-03-30 09:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f619023c-88a6-5aa9-929a-dbec344354a8 with scrape type 1
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f619023c-88a6-5aa9-929a-dbec344354a8
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_5caaf67dc15835d39282e56f49571163.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_5caaf67dc15835d39282e56f49571163.jpg not downloaded yet
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee254e190>
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_d60e39ecd3243c4e82acfb10103eae39.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_d60e39ecd3243c4e82acfb10103eae39.jpg saved to cache
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d98c1aa-f077-5c28-94a2-e207e831e674
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0f8e310>
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_7450d497a3086031a703790e3d24a255.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_7450d497a3086031a703790e3d24a255.jpg saved to cache
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d98c1aa-f077-5c28-94a2-e207e831e674
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fa2cd0>
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_9a6d10d0a4579d48277169cac5a3508b.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_9a6d10d0a4579d48277169cac5a3508b.jpg saved to cache
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffb76fe2-156f-5adc-b14e-9da41f16948e
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0faaad0>
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_2d1413bf8bbd43d707bd41f7debc5fb7.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_2d1413bf8bbd43d707bd41f7debc5fb7.jpg saved to cache
2026-03-30 09:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d98c1aa-f077-5c28-94a2-e207e831e674
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0f8f9d0>
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330/c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F82%252F8082c638323a907eab007a71a0125a2c%252Fpa%252FRJ74890_2fa0cd33a347676269579fa85ba33a4c.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_2fa0cd33a347676269579fa85ba33a4c.jpg saved to cache
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee280db50>
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_e452fddba8f1f3d22b819e39131d6de2.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e452fddba8f1f3d22b819e39131d6de2.jpg saved to cache
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffb76fe2-156f-5adc-b14e-9da41f16948e
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fa2510>
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330/c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F82%252F8082c638323a907eab007a71a0125a2c%252Fpa%252FRJ74890_cc8017b2fa91ecf20f9fd309dd98bf83.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_cc8017b2fa91ecf20f9fd309dd98bf83.jpg saved to cache
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fa53d0>
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_848d36fa96ed36e9d5493fc08b698f3a.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_848d36fa96ed36e9d5493fc08b698f3a.jpg saved to cache
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffb76fe2-156f-5adc-b14e-9da41f16948e
2026-03-30 09:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_414888cc1f5c647e376220257e86729a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_08709293e03908babaa1925aa56a2c61.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_1a575d2453db8e583aae55b26cca27e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: HW13638
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: VP28061
2026-03-30 09:07:32 [auto1.it] INFO: Found listing with ID: HP25104
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP25104%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [auto1.it] INFO: Scrape type for HP25104: 2
2026-03-30 09:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6609c780-2f12-5954-acf6-68087b25673f with identifier: HP25104
2026-03-30 09:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6609c780-2f12-5954-acf6-68087b25673f with scrape type 2
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6609c780-2f12-5954-acf6-68087b25673f with scrape type 2
2026-03-30 09:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6609c780-2f12-5954-acf6-68087b25673f, identifier: HP25104
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_e09c2da70461e7d212da380b7c5063ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e09c2da70461e7d212da380b7c5063ce.jpg not downloaded yet
2026-03-30 09:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a84a589-6a6c-54d9-971a-3feae306d508 with identifier: DW74662
2026-03-30 09:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a84a589-6a6c-54d9-971a-3feae306d508 with identifier: DW74662
2026-03-30 09:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a84a589-6a6c-54d9-971a-3feae306d508 with identifier: DW74662 to the API
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:56:10Z',
 'fuel_type': 'diesel',
 'id': '6a84a589-6a6c-54d9-971a-3feae306d508',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW74662',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 185676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-20',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW74662%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [auto1.it] INFO: Saving data for DW74662: {'auction_closing_time': 1774972570.0, 'created_time': 1774343262.521904, 'last_price_update_time': 1774861652.667012}
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW74662') HTTP/1.1" 204 0
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_617e4e04859a1cc400204cc01f134b6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_617e4e04859a1cc400204cc01f134b6c.jpg not downloaded yet
2026-03-30 09:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6609c780-2f12-5954-acf6-68087b25673f with identifier: HP25104
2026-03-30 09:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6609c780-2f12-5954-acf6-68087b25673f with identifier: HP25104
2026-03-30 09:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6609c780-2f12-5954-acf6-68087b25673f with identifier: HP25104 to the API
2026-03-30 09:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:33:14Z',
 'fuel_type': 'petrol',
 'id': '6609c780-2f12-5954-acf6-68087b25673f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP25104',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 134267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-10',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP25104%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Saving data for HP25104: {'auction_closing_time': 1774971194.0, 'created_time': 1773129476.107289, 'last_price_update_time': 1774861653.154447}
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HP25104') HTTP/1.1" 204 0
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_714f4216d940c0d66803d79849b57314.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_714f4216d940c0d66803d79849b57314.jpg not downloaded yet
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: DA96064
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA96064%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Scrape type for DA96064: 2
2026-03-30 09:07:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8150a858-51d0-5659-a907-2d513d58d967 with identifier: DA96064
2026-03-30 09:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8150a858-51d0-5659-a907-2d513d58d967 with scrape type 2
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8150a858-51d0-5659-a907-2d513d58d967 with scrape type 2
2026-03-30 09:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8150a858-51d0-5659-a907-2d513d58d967, identifier: DA96064
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_3cdb2ecd7940cda2ce2395f3863e93df.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_3cdb2ecd7940cda2ce2395f3863e93df.jpg not downloaded yet
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_bc2e0cc3e461d8021d37386effd5f276.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_bc2e0cc3e461d8021d37386effd5f276.jpg not downloaded yet
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13946d0>
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330/c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F82%252F8082c638323a907eab007a71a0125a2c%252Fpa%252FRJ74890_e4b51390397fb825d81fe677aa661dca.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_e4b51390397fb825d81fe677aa661dca.jpg saved to cache
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48e1150>
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_d9069787cfe356422f06a66e66e4f9e5.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_d9069787cfe356422f06a66e66e4f9e5.jpg saved to cache
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afbb5720-7505-50aa-8f4a-f5590cc13331
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2490b50>
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9/0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5b%252Fa85bc7415191c842746e57db8f5238e3%252Fpa%252FRP34917_ece037bbdc2798d6ddfdebec80a841e4.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_ece037bbdc2798d6ddfdebec80a841e4.jpg saved to cache
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee253b750>
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_8e5a13d9f8a971ddeea4fb455d1db3a6.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_8e5a13d9f8a971ddeea4fb455d1db3a6.jpg saved to cache
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d98c1aa-f077-5c28-94a2-e207e831e674
2026-03-30 09:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_c0f3add9a7976b3b7bfe708ec9172fb4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: FX22483
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: VW75885
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: ZB56283
2026-03-30 09:07:33 [auto1.it] INFO: Found listing with ID: PY44760
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY44760%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [auto1.it] INFO: Scrape type for PY44760: 2
2026-03-30 09:07:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff8ee32f-3687-5607-90bc-e39bb673d984 with identifier: PY44760
2026-03-30 09:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff8ee32f-3687-5607-90bc-e39bb673d984 with scrape type 2
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff8ee32f-3687-5607-90bc-e39bb673d984 with scrape type 2
2026-03-30 09:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff8ee32f-3687-5607-90bc-e39bb673d984, identifier: PY44760
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_e86916f22fc587298331320b8d6d3a1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e86916f22fc587298331320b8d6d3a1b.jpg not downloaded yet
2026-03-30 09:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8150a858-51d0-5659-a907-2d513d58d967 with identifier: DA96064
2026-03-30 09:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8150a858-51d0-5659-a907-2d513d58d967 with identifier: DA96064
2026-03-30 09:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8150a858-51d0-5659-a907-2d513d58d967 with identifier: DA96064 to the API
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:29:09Z',
 'fuel_type': 'petrol',
 'id': '8150a858-51d0-5659-a907-2d513d58d967',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA96064',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Bayon',
 'odometer': 36561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-26',
 'seller_name': None,
 'title': 'Hyundai Bayon 1.0 T-GDI Mild-Hybrid XLine 2WD',
 'transmission': 'manual',
 'trim': 'XLine 2WD',
 'year': 2024}
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA96064%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [auto1.it] INFO: Saving data for DA96064: {'auction_closing_time': 1774970949.0, 'created_time': 1773236845.502253, 'last_price_update_time': 1774861654.100625}
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA96064') HTTP/1.1" 204 0
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_5eba2f1b288e4ce418df990e312426a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_5eba2f1b288e4ce418df990e312426a5.jpg not downloaded yet
2026-03-30 09:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_c4dc4733e408d5d7f0c5e9572ae1d368.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_f4835b2db4683e8fe3406874ebdf6020.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_72a9b0c4bfb9e6a526c11e364bda2f3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_81de64171288e458f7fda6fb2f0fe993.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff8ee32f-3687-5607-90bc-e39bb673d984 with identifier: PY44760
2026-03-30 09:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff8ee32f-3687-5607-90bc-e39bb673d984 with identifier: PY44760
2026-03-30 09:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff8ee32f-3687-5607-90bc-e39bb673d984 with identifier: PY44760 to the API
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:38:26Z',
 'fuel_type': 'diesel',
 'id': 'ff8ee32f-3687-5607-90bc-e39bb673d984',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY44760',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS5',
 'odometer': 156593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-05',
 'seller_name': None,
 'title': 'DS Automobiles DS5 2.0 Blue-HDi SportChic',
 'transmission': 'automatic',
 'trim': 'SportChic',
 'year': 2016}
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY44760%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [auto1.it] INFO: Saving data for PY44760: {'auction_closing_time': 1774971506.0, 'created_time': 1773267555.069797, 'last_price_update_time': 1774861654.536928}
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PY44760') HTTP/1.1" 204 0
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_30245fe3a7b3bd4b66e5661dbe2f99a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_30245fe3a7b3bd4b66e5661dbe2f99a7.jpg not downloaded yet
2026-03-30 09:07:34 [auto1.it] INFO: Found listing with ID: SD84714
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD84714%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [auto1.it] INFO: Scrape type for SD84714: 2
2026-03-30 09:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84b508aa-2f14-507c-a671-fcbc781c730c with identifier: SD84714
2026-03-30 09:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84b508aa-2f14-507c-a671-fcbc781c730c with scrape type 2
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84b508aa-2f14-507c-a671-fcbc781c730c with scrape type 2
2026-03-30 09:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 84b508aa-2f14-507c-a671-fcbc781c730c, identifier: SD84714
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_e18d05b561994d69d11a3b99156be7db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_e18d05b561994d69d11a3b99156be7db.jpg not downloaded yet
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_c638cf11c22ef9fc592c3ef0638e98e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_c638cf11c22ef9fc592c3ef0638e98e9.jpg not downloaded yet
2026-03-30 09:07:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2677690>
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_5affe906167f6d024a902ce08af59642.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_5affe906167f6d024a902ce08af59642.jpg saved to cache
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d98c1aa-f077-5c28-94a2-e207e831e674
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1264210>
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_414888cc1f5c647e376220257e86729a.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_414888cc1f5c647e376220257e86729a.jpg saved to cache
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffb76fe2-156f-5adc-b14e-9da41f16948e
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fe8c90>
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_08709293e03908babaa1925aa56a2c61.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_08709293e03908babaa1925aa56a2c61.jpg saved to cache
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffb76fe2-156f-5adc-b14e-9da41f16948e
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fff250>
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_1a575d2453db8e583aae55b26cca27e8.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_1a575d2453db8e583aae55b26cca27e8.jpg saved to cache
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afbb5720-7505-50aa-8f4a-f5590cc13331
2026-03-30 09:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_ad2abce50ade4f1ac8d0d12f50981c0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_4919f112480e577ffb496da129a02e43.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:34 [auto1.it] INFO: Found listing with ID: ZD91383
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD91383%27 HTTP/1.1" 200 None
2026-03-30 09:07:34 [auto1.it] INFO: Scrape type for ZD91383: 2
2026-03-30 09:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bdd4d06-0ae5-5e59-856c-9708395476f7 with identifier: ZD91383
2026-03-30 09:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bdd4d06-0ae5-5e59-856c-9708395476f7 with scrape type 2
2026-03-30 09:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bdd4d06-0ae5-5e59-856c-9708395476f7 with scrape type 2
2026-03-30 09:07:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2bdd4d06-0ae5-5e59-856c-9708395476f7, identifier: ZD91383
2026-03-30 09:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 84b508aa-2f14-507c-a671-fcbc781c730c with identifier: SD84714
2026-03-30 09:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 84b508aa-2f14-507c-a671-fcbc781c730c with identifier: SD84714
2026-03-30 09:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 84b508aa-2f14-507c-a671-fcbc781c730c with identifier: SD84714 to the API
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:24:47Z',
 'fuel_type': 'petrol',
 'id': '84b508aa-2f14-507c-a671-fcbc781c730c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD84714',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 37443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2020}
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD84714%27 HTTP/1.1" 200 None
2026-03-30 09:07:35 [auto1.it] INFO: Saving data for SD84714: {'auction_closing_time': 1774970687.0, 'created_time': 1774472805.387363, 'last_price_update_time': 1774861655.41581}
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD84714') HTTP/1.1" 204 0
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_f7a1c9e8854be474eec515f524a6cc6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_f7a1c9e8854be474eec515f524a6cc6a.jpg not downloaded yet
2026-03-30 09:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_65f774dd6a4dbc1c6666bf276cd1c39e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_dd5a6b138598bf7f26cc485c42dbabc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2bdd4d06-0ae5-5e59-856c-9708395476f7 with identifier: ZD91383
2026-03-30 09:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2bdd4d06-0ae5-5e59-856c-9708395476f7 with identifier: ZD91383
2026-03-30 09:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2bdd4d06-0ae5-5e59-856c-9708395476f7 with identifier: ZD91383 to the API
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:32:11Z',
 'fuel_type': 'diesel',
 'id': '2bdd4d06-0ae5-5e59-856c-9708395476f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD91383',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 122947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-15',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2016}
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD91383%27 HTTP/1.1" 200 None
2026-03-30 09:07:35 [auto1.it] INFO: Saving data for ZD91383: {'auction_closing_time': 1774971131.0, 'created_time': 1773237285.864002, 'last_price_update_time': 1774861655.887556}
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZD91383') HTTP/1.1" 204 0
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_46367540d01056b537a355242935a34c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_46367540d01056b537a355242935a34c.jpg not downloaded yet
2026-03-30 09:07:35 [auto1.it] INFO: Found listing with ID: CY17500
2026-03-30 09:07:35 [auto1.it] INFO: Found listing with ID: WE25816
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE25816%27 HTTP/1.1" 200 None
2026-03-30 09:07:35 [auto1.it] INFO: Scrape type for WE25816: 2
2026-03-30 09:07:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80d2e9cd-3eb4-5ce3-a8a0-b51ab8a83bf3 with identifier: WE25816
2026-03-30 09:07:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d2e9cd-3eb4-5ce3-a8a0-b51ab8a83bf3 with scrape type 2
2026-03-30 09:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80d2e9cd-3eb4-5ce3-a8a0-b51ab8a83bf3 with scrape type 2
2026-03-30 09:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 80d2e9cd-3eb4-5ce3-a8a0-b51ab8a83bf3, identifier: WE25816
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_1ae8b2462bb491c82a43734f72e20f39.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_1ae8b2462bb491c82a43734f72e20f39.jpg not downloaded yet
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_afea595dee97d3dc7459d90438366207.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_afea595dee97d3dc7459d90438366207.jpg not downloaded yet
2026-03-30 09:07:36 [auto1.it] INFO: Found listing with ID: UY37095
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY37095%27 HTTP/1.1" 200 None
2026-03-30 09:07:36 [auto1.it] INFO: Scrape type for UY37095: 2
2026-03-30 09:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed09c0d-daa4-5e46-ac5b-11c15d4af9c3 with identifier: UY37095
2026-03-30 09:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed09c0d-daa4-5e46-ac5b-11c15d4af9c3 with scrape type 2
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fed09c0d-daa4-5e46-ac5b-11c15d4af9c3 with scrape type 2
2026-03-30 09:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fed09c0d-daa4-5e46-ac5b-11c15d4af9c3, identifier: UY37095
2026-03-30 09:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 80d2e9cd-3eb4-5ce3-a8a0-b51ab8a83bf3 with identifier: WE25816
2026-03-30 09:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 80d2e9cd-3eb4-5ce3-a8a0-b51ab8a83bf3 with identifier: WE25816
2026-03-30 09:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 80d2e9cd-3eb4-5ce3-a8a0-b51ab8a83bf3 with identifier: WE25816 to the API
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:22:48Z',
 'fuel_type': 'diesel',
 'id': '80d2e9cd-3eb4-5ce3-a8a0-b51ab8a83bf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE25816',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 151561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Business BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business BlueMotion',
 'year': 2019}
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE25816%27 HTTP/1.1" 200 None
2026-03-30 09:07:36 [auto1.it] INFO: Saving data for WE25816: {'auction_closing_time': 1774970568.0, 'created_time': 1774440422.500716, 'last_price_update_time': 1774861656.772999}
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WE25816') HTTP/1.1" 204 0
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_9a50ece33d8a6deb8e8154b262bcf43f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_9a50ece33d8a6deb8e8154b262bcf43f.jpg not downloaded yet
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0ffecd0>
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_c0f3add9a7976b3b7bfe708ec9172fb4.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_c0f3add9a7976b3b7bfe708ec9172fb4.jpg saved to cache
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffb76fe2-156f-5adc-b14e-9da41f16948e
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27f67d0>
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_c4dc4733e408d5d7f0c5e9572ae1d368.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_c4dc4733e408d5d7f0c5e9572ae1d368.jpg saved to cache
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6f2111c-ca9f-5633-834a-ea798b46fabd
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27d2350>
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_f4835b2db4683e8fe3406874ebdf6020.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_f4835b2db4683e8fe3406874ebdf6020.jpg saved to cache
2026-03-30 09:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d98c1aa-f077-5c28-94a2-e207e831e674
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1204ad0>
2026-03-30 09:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9/0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5b%252Fa85bc7415191c842746e57db8f5238e3%252Fpa%252FRP34917_72a9b0c4bfb9e6a526c11e364bda2f3c.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_72a9b0c4bfb9e6a526c11e364bda2f3c.jpg saved to cache
2026-03-30 09:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9
2026-03-30 09:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26c7fd0>
2026-03-30 09:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_81de64171288e458f7fda6fb2f0fe993.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_81de64171288e458f7fda6fb2f0fe993.jpg saved to cache
2026-03-30 09:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d98c1aa-f077-5c28-94a2-e207e831e674
2026-03-30 09:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_617e4e04859a1cc400204cc01f134b6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_4bec2271ba2036d36d3fc6be0ce3608a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_5caaf67dc15835d39282e56f49571163.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_94d7687a5c30202bf26d564113eee8ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_69d3adba9cf18e4abb0c620d70785426.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_1bdd266db3bf9133fcfe6c06276ae0ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fed09c0d-daa4-5e46-ac5b-11c15d4af9c3 with identifier: UY37095
2026-03-30 09:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fed09c0d-daa4-5e46-ac5b-11c15d4af9c3 with identifier: UY37095
2026-03-30 09:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fed09c0d-daa4-5e46-ac5b-11c15d4af9c3 with identifier: UY37095 to the API
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:09:12Z',
 'fuel_type': 'petrol',
 'id': 'fed09c0d-daa4-5e46-ac5b-11c15d4af9c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY37095',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 150236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-09',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2005}
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY37095%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [auto1.it] INFO: Saving data for UY37095: {'auction_closing_time': 1774969752.0, 'created_time': 1774386350.973825, 'last_price_update_time': 1774861657.522411}
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UY37095') HTTP/1.1" 204 0
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_9b6806a8ca9b1bfcd405909b630dba18.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_9b6806a8ca9b1bfcd405909b630dba18.jpg not downloaded yet
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: RV54155
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV54155%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [auto1.it] INFO: Scrape type for RV54155: 2
2026-03-30 09:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93707ffe-9466-5f88-8c4f-e89a4a1ac2bc with identifier: RV54155
2026-03-30 09:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93707ffe-9466-5f88-8c4f-e89a4a1ac2bc with scrape type 2
2026-03-30 09:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93707ffe-9466-5f88-8c4f-e89a4a1ac2bc with scrape type 2
2026-03-30 09:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 93707ffe-9466-5f88-8c4f-e89a4a1ac2bc, identifier: RV54155
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_e620d4e8b6bff559b3f0e4a28fa77b13.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_e620d4e8b6bff559b3f0e4a28fa77b13.jpg not downloaded yet
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_19aa6dc06a7345c17368a80e09712ff5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_19aa6dc06a7345c17368a80e09712ff5.jpg not downloaded yet
2026-03-30 09:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ15185> (referer: https://www.auto1.com/v1/car-details-view/XJ15185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:37 [auto1.it] INFO: Found listing with ID: GY68527
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY68527%27 HTTP/1.1" 200 None
2026-03-30 09:07:37 [auto1.it] INFO: Scrape type for GY68527: 2
2026-03-30 09:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97fb834a-b1ff-5018-99f5-9152652f8baf with identifier: GY68527
2026-03-30 09:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97fb834a-b1ff-5018-99f5-9152652f8baf with scrape type 2
2026-03-30 09:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97fb834a-b1ff-5018-99f5-9152652f8baf with scrape type 2
2026-03-30 09:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97fb834a-b1ff-5018-99f5-9152652f8baf, identifier: GY68527
2026-03-30 09:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 93707ffe-9466-5f88-8c4f-e89a4a1ac2bc with identifier: RV54155
2026-03-30 09:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 93707ffe-9466-5f88-8c4f-e89a4a1ac2bc with identifier: RV54155
2026-03-30 09:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 93707ffe-9466-5f88-8c4f-e89a4a1ac2bc with identifier: RV54155 to the API
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:33:28Z',
 'fuel_type': 'diesel',
 'id': '93707ffe-9466-5f88-8c4f-e89a4a1ac2bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV54155',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 240815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-28',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI AMG Sport',
 'transmission': 'automatic',
 'trim': 'AMG Sport',
 'year': 2015}
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV54155%27 HTTP/1.1" 200 None
2026-03-30 09:07:38 [auto1.it] INFO: Saving data for RV54155: {'auction_closing_time': 1774971208.0, 'created_time': 1774472834.095401, 'last_price_update_time': 1774861658.311634}
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RV54155') HTTP/1.1" 204 0
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_d3e3e1c276abccf5597327334c061e5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_d3e3e1c276abccf5597327334c061e5f.jpg not downloaded yet
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1449650>
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_ad2abce50ade4f1ac8d0d12f50981c0d.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_ad2abce50ade4f1ac8d0d12f50981c0d.jpg saved to cache
2026-03-30 09:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afbb5720-7505-50aa-8f4a-f5590cc13331
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee263d890>
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9/0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5b%252Fa85bc7415191c842746e57db8f5238e3%252Fpa%252FRP34917_4919f112480e577ffb496da129a02e43.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_4919f112480e577ffb496da129a02e43.jpg saved to cache
2026-03-30 09:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2614490>
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_65f774dd6a4dbc1c6666bf276cd1c39e.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_65f774dd6a4dbc1c6666bf276cd1c39e.jpg saved to cache
2026-03-30 09:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21c6d778-d381-54d0-8677-1db7cd23fbba
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12d4bd0>
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_dd5a6b138598bf7f26cc485c42dbabc0.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_dd5a6b138598bf7f26cc485c42dbabc0.jpg saved to cache
2026-03-30 09:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6f2111c-ca9f-5633-834a-ea798b46fabd
2026-03-30 09:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97fb834a-b1ff-5018-99f5-9152652f8baf with identifier: GY68527
2026-03-30 09:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97fb834a-b1ff-5018-99f5-9152652f8baf with identifier: GY68527
2026-03-30 09:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97fb834a-b1ff-5018-99f5-9152652f8baf with identifier: GY68527 to the API
2026-03-30 09:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:57:44Z',
 'fuel_type': 'diesel',
 'id': '97fb834a-b1ff-5018-99f5-9152652f8baf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY68527',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Fiorino',
 'odometer': 56024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-17',
 'seller_name': None,
 'title': 'Fiat Fiorino 1.3 JTD SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2009}
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY68527%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [auto1.it] INFO: Saving data for GY68527: {'auction_closing_time': 1774972664.0, 'created_time': 1773954682.109457, 'last_price_update_time': 1774861659.130333}
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY68527') HTTP/1.1" 204 0
2026-03-30 09:07:39 [auto1.it] INFO: Found listing with ID: XX98106
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX98106%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [auto1.it] INFO: Scrape type for XX98106: 2
2026-03-30 09:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ccd662-cf8d-5b98-9ada-3e01b534d915 with identifier: XX98106
2026-03-30 09:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ccd662-cf8d-5b98-9ada-3e01b534d915 with scrape type 2
2026-03-30 09:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5ccd662-cf8d-5b98-9ada-3e01b534d915 with scrape type 2
2026-03-30 09:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5ccd662-cf8d-5b98-9ada-3e01b534d915, identifier: XX98106
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_f91bdc1699bf4ef30800ecb0b2bc80b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_f91bdc1699bf4ef30800ecb0b2bc80b3.jpg not downloaded yet
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_bb97d78e9c592e08416c8686a794f58a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_bb97d78e9c592e08416c8686a794f58a.jpg not downloaded yet
2026-03-30 09:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_f7a1c9e8854be474eec515f524a6cc6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_5eba2f1b288e4ce418df990e312426a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e86916f22fc587298331320b8d6d3a1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_714f4216d940c0d66803d79849b57314.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_3cdb2ecd7940cda2ce2395f3863e93df.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_bc2e0cc3e461d8021d37386effd5f276.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:39 [auto1.it] INFO: Found listing with ID: SY55940
2026-03-30 09:07:39 [auto1.it] INFO: Found listing with ID: ES04012
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES04012%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [auto1.it] INFO: Scrape type for ES04012: 2
2026-03-30 09:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca008a8-9f8f-5835-b5d0-0a34df77beea with identifier: ES04012
2026-03-30 09:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ca008a8-9f8f-5835-b5d0-0a34df77beea with scrape type 2
2026-03-30 09:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ca008a8-9f8f-5835-b5d0-0a34df77beea with scrape type 2
2026-03-30 09:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2ca008a8-9f8f-5835-b5d0-0a34df77beea, identifier: ES04012
2026-03-30 09:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5ccd662-cf8d-5b98-9ada-3e01b534d915 with identifier: XX98106
2026-03-30 09:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5ccd662-cf8d-5b98-9ada-3e01b534d915 with identifier: XX98106
2026-03-30 09:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5ccd662-cf8d-5b98-9ada-3e01b534d915 with identifier: XX98106 to the API
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:33:56Z',
 'fuel_type': 'diesel',
 'id': 'f5ccd662-cf8d-5b98-9ada-3e01b534d915',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX98106',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 90619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-02',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2018}
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX98106%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [auto1.it] INFO: Saving data for XX98106: {'auction_closing_time': 1774971236.0, 'created_time': 1773380826.325255, 'last_price_update_time': 1774861659.91189}
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX98106') HTTP/1.1" 204 0
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_eaaf6fb6de25a8843df5bfc3cb3bd59e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_eaaf6fb6de25a8843df5bfc3cb3bd59e.jpg not downloaded yet
2026-03-30 09:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_afea595dee97d3dc7459d90438366207.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_c638cf11c22ef9fc592c3ef0638e98e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2ca008a8-9f8f-5835-b5d0-0a34df77beea with identifier: ES04012
2026-03-30 09:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2ca008a8-9f8f-5835-b5d0-0a34df77beea with identifier: ES04012
2026-03-30 09:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2ca008a8-9f8f-5835-b5d0-0a34df77beea with identifier: ES04012 to the API
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:19:00Z',
 'fuel_type': 'diesel',
 'id': '2ca008a8-9f8f-5835-b5d0-0a34df77beea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES04012',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 172683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-27',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.3 JTD Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2014}
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES04012%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Saving data for ES04012: {'auction_closing_time': 1774970340.0, 'created_time': 1774473189.817147, 'last_price_update_time': 1774861660.352348}
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ES04012') HTTP/1.1" 204 0
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: LP02443
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: YJ98876
2026-03-30 09:07:40 [auto1.it] INFO: Found listing with ID: MH70269
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH70269%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [auto1.it] INFO: Scrape type for MH70269: 2
2026-03-30 09:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 047023dd-8b17-5019-b7e9-af24ea237933 with identifier: MH70269
2026-03-30 09:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 047023dd-8b17-5019-b7e9-af24ea237933 with scrape type 2
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 047023dd-8b17-5019-b7e9-af24ea237933 with scrape type 2
2026-03-30 09:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 047023dd-8b17-5019-b7e9-af24ea237933, identifier: MH70269
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_b769133860ab4d09291eb5eb7946d403.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_b769133860ab4d09291eb5eb7946d403.jpg not downloaded yet
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_ee8f96da332243ddacb21a73423927e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_ee8f96da332243ddacb21a73423927e1.jpg not downloaded yet
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2614310>
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_617e4e04859a1cc400204cc01f134b6c.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_617e4e04859a1cc400204cc01f134b6c.jpg saved to cache
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21c6d778-d381-54d0-8677-1db7cd23fbba
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25048d0>
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_4bec2271ba2036d36d3fc6be0ce3608a.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_4bec2271ba2036d36d3fc6be0ce3608a.jpg saved to cache
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afbb5720-7505-50aa-8f4a-f5590cc13331
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1117310>
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_5caaf67dc15835d39282e56f49571163.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_5caaf67dc15835d39282e56f49571163.jpg saved to cache
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f619023c-88a6-5aa9-929a-dbec344354a8
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee271ff90>
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_94d7687a5c30202bf26d564113eee8ab.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_94d7687a5c30202bf26d564113eee8ab.jpg saved to cache
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d98c1aa-f077-5c28-94a2-e207e831e674
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fbcbd0>
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_69d3adba9cf18e4abb0c620d70785426.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_69d3adba9cf18e4abb0c620d70785426.jpg saved to cache
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffb76fe2-156f-5adc-b14e-9da41f16948e
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1231f90>
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_1bdd266db3bf9133fcfe6c06276ae0ce.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_1bdd266db3bf9133fcfe6c06276ae0ce.jpg saved to cache
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6f2111c-ca9f-5633-834a-ea798b46fabd
2026-03-30 09:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d828cae2-537b-5403-a01e-057558bf231f with identifier: XJ15185
2026-03-30 09:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d828cae2-537b-5403-a01e-057558bf231f with scrape type 1
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d828cae2-537b-5403-a01e-057558bf231f
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Faf%252F1baf5e6685e0a03c95a7a67214acf13e%252Fpa%252FXJ15185_e9529fd329fbb643aff7faf54e8d9bb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_e9529fd329fbb643aff7faf54e8d9bb9.jpg already downloaded
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Faf%252F1baf5e6685e0a03c95a7a67214acf13e%252Fpa%252FXJ15185_a19042668b6eae3dd12d9e90fbff148c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_a19042668b6eae3dd12d9e90fbff148c.jpg already downloaded
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Faf%252F1baf5e6685e0a03c95a7a67214acf13e%252Fpa%252FXJ15185_9b0665fa128fb549ee1a13bb0949067a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_9b0665fa128fb549ee1a13bb0949067a.jpg already downloaded
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Faf%252F1baf5e6685e0a03c95a7a67214acf13e%252Fpa%252FXJ15185_8700cf26023dd812dda230e5ac6e95e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_8700cf26023dd812dda230e5ac6e95e5.jpg already downloaded
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Faf%252F1baf5e6685e0a03c95a7a67214acf13e%252Fpa%252FXJ15185_05cb113398069a9c299809115fad0df2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_05cb113398069a9c299809115fad0df2.jpg already downloaded
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Faf%252F1baf5e6685e0a03c95a7a67214acf13e%252Fpa%252FXJ15185_d4a9cf4d42602ab7c4a9334ba153223f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_d4a9cf4d42602ab7c4a9334ba153223f.jpg already downloaded
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Faf%252F1baf5e6685e0a03c95a7a67214acf13e%252Fpa%252FXJ15185_d36efb6d20f22b8793737e485c447761.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_d36efb6d20f22b8793737e485c447761.jpg already downloaded
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Faf%252F1baf5e6685e0a03c95a7a67214acf13e%252Fpa%252FXJ15185_bcfca868f4feea107872e57e23a40a22.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_bcfca868f4feea107872e57e23a40a22.jpg already downloaded
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Faf%252F1baf5e6685e0a03c95a7a67214acf13e%252Fpa%252FXJ15185_e7cd3d54414ead82bd58fe079dd7456f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_e7cd3d54414ead82bd58fe079dd7456f.jpg already downloaded
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Faf%252F1baf5e6685e0a03c95a7a67214acf13e%252Fpa%252FXJ15185_0d1790c0df31a07aaa1e987fc5e44fb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_0d1790c0df31a07aaa1e987fc5e44fb7.jpg already downloaded
2026-03-30 09:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d828cae2-537b-5403-a01e-057558bf231f, identifier: XJ15185
2026-03-30 09:07:41 [auto1.it] INFO: Found listing with ID: YK56738
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK56738%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [auto1.it] INFO: Scrape type for YK56738: 2
2026-03-30 09:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cef89dc6-7e57-514a-b140-9379c49156a5 with identifier: YK56738
2026-03-30 09:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cef89dc6-7e57-514a-b140-9379c49156a5 with scrape type 2
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cef89dc6-7e57-514a-b140-9379c49156a5 with scrape type 2
2026-03-30 09:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cef89dc6-7e57-514a-b140-9379c49156a5, identifier: YK56738
2026-03-30 09:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 047023dd-8b17-5019-b7e9-af24ea237933 with identifier: MH70269
2026-03-30 09:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 047023dd-8b17-5019-b7e9-af24ea237933 with identifier: MH70269
2026-03-30 09:07:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 047023dd-8b17-5019-b7e9-af24ea237933 with identifier: MH70269 to the API
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:43:47Z',
 'fuel_type': 'diesel',
 'id': '047023dd-8b17-5019-b7e9-af24ea237933',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH70269',
 'listing': 'auction',
 'make': 'EVO',
 'model': '4',
 'odometer': 69873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-01',
 'seller_name': None,
 'title': 'EVO 4 2.0 TD',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH70269%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [auto1.it] INFO: Saving data for MH70269: {'auction_closing_time': 1774971827.0, 'created_time': 1773135766.489934, 'last_price_update_time': 1774861661.790817}
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MH70269') HTTP/1.1" 204 0
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_9126318620458683bfc7c58ec29c9012.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_9126318620458683bfc7c58ec29c9012.jpg not downloaded yet
2026-03-30 09:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d828cae2-537b-5403-a01e-057558bf231f with identifier: XJ15185
2026-03-30 09:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d828cae2-537b-5403-a01e-057558bf231f with identifier: XJ15185
2026-03-30 09:07:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d828cae2-537b-5403-a01e-057558bf231f with identifier: XJ15185 to the API
2026-03-30 09:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XJ15185>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:54:26Z',
 'fuel_type': 'petrol',
 'id': 'd828cae2-537b-5403-a01e-057558bf231f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ15185',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 174735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_e9529fd329fbb643aff7faf54e8d9bb9.jpg',
                'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_a19042668b6eae3dd12d9e90fbff148c.jpg',
                'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_9b0665fa128fb549ee1a13bb0949067a.jpg',
                'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_8700cf26023dd812dda230e5ac6e95e5.jpg',
                'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_05cb113398069a9c299809115fad0df2.jpg',
                'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_d4a9cf4d42602ab7c4a9334ba153223f.jpg',
                'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_d36efb6d20f22b8793737e485c447761.jpg',
                'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_bcfca868f4feea107872e57e23a40a22.jpg',
                'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_e7cd3d54414ead82bd58fe079dd7456f.jpg',
                'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_0d1790c0df31a07aaa1e987fc5e44fb7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d828cae2-537b-5403-a01e-057558bf231f/d828cae2-537b-5403-a01e-057558bf231f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_e9529fd329fbb643aff7faf54e8d9bb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d828cae2-537b-5403-a01e-057558bf231f/d828cae2-537b-5403-a01e-057558bf231f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2727110,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_a19042668b6eae3dd12d9e90fbff148c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d828cae2-537b-5403-a01e-057558bf231f/d828cae2-537b-5403-a01e-057558bf231f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2319394,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_9b0665fa128fb549ee1a13bb0949067a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d828cae2-537b-5403-a01e-057558bf231f/d828cae2-537b-5403-a01e-057558bf231f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_8700cf26023dd812dda230e5ac6e95e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d828cae2-537b-5403-a01e-057558bf231f/d828cae2-537b-5403-a01e-057558bf231f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2457549,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_05cb113398069a9c299809115fad0df2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d828cae2-537b-5403-a01e-057558bf231f/d828cae2-537b-5403-a01e-057558bf231f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_d4a9cf4d42602ab7c4a9334ba153223f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d828cae2-537b-5403-a01e-057558bf231f/d828cae2-537b-5403-a01e-057558bf231f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_d36efb6d20f22b8793737e485c447761.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d828cae2-537b-5403-a01e-057558bf231f/d828cae2-537b-5403-a01e-057558bf231f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2501269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_bcfca868f4feea107872e57e23a40a22.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d828cae2-537b-5403-a01e-057558bf231f/d828cae2-537b-5403-a01e-057558bf231f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_e7cd3d54414ead82bd58fe079dd7456f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d828cae2-537b-5403-a01e-057558bf231f/d828cae2-537b-5403-a01e-057558bf231f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2563128,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/af/1baf5e6685e0a03c95a7a67214acf13e/pa/XJ15185_0d1790c0df31a07aaa1e987fc5e44fb7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis Prime',
 'transmission': 'automatic',
 'trim': 'Basis Prime',
 'year': 2016}
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ15185%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [auto1.it] INFO: Saving data for XJ15185: {'created_time': 1774861662.26256, 'last_price_update_time': 1774861662.262571, 'auction_closing_time': 1774972466.0}
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XJ15185') HTTP/1.1" 204 0
2026-03-30 09:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cef89dc6-7e57-514a-b140-9379c49156a5 with identifier: YK56738
2026-03-30 09:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cef89dc6-7e57-514a-b140-9379c49156a5 with identifier: YK56738
2026-03-30 09:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cef89dc6-7e57-514a-b140-9379c49156a5 with identifier: YK56738 to the API
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:54:30Z',
 'fuel_type': 'diesel',
 'id': 'cef89dc6-7e57-514a-b140-9379c49156a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK56738',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 106222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-21',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK56738%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [auto1.it] INFO: Saving data for YK56738: {'auction_closing_time': 1774972470.0, 'created_time': 1773997716.786244, 'last_price_update_time': 1774861662.71803}
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YK56738') HTTP/1.1" 204 0
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: VC90612
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: YX73536
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: WT52400
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: HS01287
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS01287%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [auto1.it] INFO: Scrape type for HS01287: 1
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_57cca1508f8a50fc717b35b346377ba2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_57cca1508f8a50fc717b35b346377ba2.jpg not downloaded yet
2026-03-30 09:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_9a50ece33d8a6deb8e8154b262bcf43f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: UM22430
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: HF31411
2026-03-30 09:07:42 [auto1.it] INFO: Found listing with ID: TL80990
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL80990%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [auto1.it] INFO: Scrape type for TL80990: 2
2026-03-30 09:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5a3c5ce-8451-5031-874a-dce1cbe0f149 with identifier: TL80990
2026-03-30 09:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5a3c5ce-8451-5031-874a-dce1cbe0f149 with scrape type 2
2026-03-30 09:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5a3c5ce-8451-5031-874a-dce1cbe0f149 with scrape type 2
2026-03-30 09:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5a3c5ce-8451-5031-874a-dce1cbe0f149, identifier: TL80990
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_5d2b49089295c9ba1739d5569b9c8945.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_5d2b49089295c9ba1739d5569b9c8945.jpg not downloaded yet
2026-03-30 09:07:42 [auto1.it] INFO: Channel: 24h | Page: 9 | totalHits: 3304 | hits on page: 40
2026-03-30 09:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2543b10>
2026-03-30 09:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_f7a1c9e8854be474eec515f524a6cc6a.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_f7a1c9e8854be474eec515f524a6cc6a.jpg saved to cache
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21c6d778-d381-54d0-8677-1db7cd23fbba
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10d5490>
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_5eba2f1b288e4ce418df990e312426a5.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_5eba2f1b288e4ce418df990e312426a5.jpg saved to cache
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21c6d778-d381-54d0-8677-1db7cd23fbba
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee271c7d0>
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_e86916f22fc587298331320b8d6d3a1b.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e86916f22fc587298331320b8d6d3a1b.jpg saved to cache
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffb76fe2-156f-5adc-b14e-9da41f16948e
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1246950>
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_714f4216d940c0d66803d79849b57314.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_714f4216d940c0d66803d79849b57314.jpg saved to cache
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item afbb5720-7505-50aa-8f4a-f5590cc13331
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee286a650>
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_3cdb2ecd7940cda2ce2395f3863e93df.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_3cdb2ecd7940cda2ce2395f3863e93df.jpg saved to cache
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6f2111c-ca9f-5633-834a-ea798b46fabd
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24bfe90>
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_bc2e0cc3e461d8021d37386effd5f276.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_bc2e0cc3e461d8021d37386effd5f276.jpg saved to cache
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f619023c-88a6-5aa9-929a-dbec344354a8
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25d8b90>
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_afea595dee97d3dc7459d90438366207.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_afea595dee97d3dc7459d90438366207.jpg saved to cache
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f619023c-88a6-5aa9-929a-dbec344354a8
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1006ad0>
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_c638cf11c22ef9fc592c3ef0638e98e9.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_c638cf11c22ef9fc592c3ef0638e98e9.jpg saved to cache
2026-03-30 09:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f619023c-88a6-5aa9-929a-dbec344354a8
2026-03-30 09:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_e18d05b561994d69d11a3b99156be7db.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_1ae8b2462bb491c82a43734f72e20f39.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_46367540d01056b537a355242935a34c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e09c2da70461e7d212da380b7c5063ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_30245fe3a7b3bd4b66e5661dbe2f99a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5a3c5ce-8451-5031-874a-dce1cbe0f149 with identifier: TL80990
2026-03-30 09:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5a3c5ce-8451-5031-874a-dce1cbe0f149 with identifier: TL80990
2026-03-30 09:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5a3c5ce-8451-5031-874a-dce1cbe0f149 with identifier: TL80990 to the API
2026-03-30 09:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:02:34Z',
 'fuel_type': 'diesel',
 'id': 'a5a3c5ce-8451-5031-874a-dce1cbe0f149',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL80990',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 291838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-11',
 'seller_name': None,
 'title': 'Volkswagen Golf V 2.0 TDI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2006}
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL80990%27 HTTP/1.1" 200 None
2026-03-30 09:07:44 [auto1.it] INFO: Saving data for TL80990: {'auction_closing_time': 1774969354.0, 'created_time': 1774429520.310827, 'last_price_update_time': 1774861664.446695}
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TL80990') HTTP/1.1" 204 0
2026-03-30 09:07:44 [auto1.it] INFO: Found listing with ID: AE23716
2026-03-30 09:07:44 [auto1.it] INFO: Found listing with ID: ZZ91306
2026-03-30 09:07:44 [auto1.it] INFO: Found listing with ID: FY27502
2026-03-30 09:07:44 [auto1.it] INFO: Found listing with ID: BX11661
2026-03-30 09:07:44 [auto1.it] INFO: Found listing with ID: FV31205
2026-03-30 09:07:44 [auto1.it] INFO: Found listing with ID: GN01544
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN01544%27 HTTP/1.1" 200 None
2026-03-30 09:07:44 [auto1.it] INFO: Scrape type for GN01544: 1
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_979bd17035a6a4e0a5e23be1ec7f8daa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_979bd17035a6a4e0a5e23be1ec7f8daa.jpg not downloaded yet
2026-03-30 09:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_f91bdc1699bf4ef30800ecb0b2bc80b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_bb97d78e9c592e08416c8686a794f58a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:44 [auto1.it] INFO: Found listing with ID: AK10390
2026-03-30 09:07:44 [auto1.it] INFO: Found listing with ID: RU60792
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU60792%27 HTTP/1.1" 200 None
2026-03-30 09:07:44 [auto1.it] INFO: Scrape type for RU60792: 2
2026-03-30 09:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ea186eb-6f55-58e3-ba4c-bd3b2a5d41a1 with identifier: RU60792
2026-03-30 09:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ea186eb-6f55-58e3-ba4c-bd3b2a5d41a1 with scrape type 2
2026-03-30 09:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ea186eb-6f55-58e3-ba4c-bd3b2a5d41a1 with scrape type 2
2026-03-30 09:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0ea186eb-6f55-58e3-ba4c-bd3b2a5d41a1, identifier: RU60792
2026-03-30 09:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_d3e3e1c276abccf5597327334c061e5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:44 [auto1.it] INFO: Found listing with ID: KT03985
2026-03-30 09:07:44 [auto1.it] INFO: Found listing with ID: TM60577
2026-03-30 09:07:44 [auto1.it] INFO: Found listing with ID: AS05452
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS05452%27 HTTP/1.1" 200 None
2026-03-30 09:07:44 [auto1.it] INFO: Scrape type for AS05452: 2
2026-03-30 09:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 794a2f14-113e-5a41-992d-afae57c992fa with identifier: AS05452
2026-03-30 09:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 794a2f14-113e-5a41-992d-afae57c992fa with scrape type 2
2026-03-30 09:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 794a2f14-113e-5a41-992d-afae57c992fa with scrape type 2
2026-03-30 09:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 794a2f14-113e-5a41-992d-afae57c992fa, identifier: AS05452
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_b3c5427339a01c74ed9e025062fe94a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_b3c5427339a01c74ed9e025062fe94a5.jpg not downloaded yet
2026-03-30 09:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0ea186eb-6f55-58e3-ba4c-bd3b2a5d41a1 with identifier: RU60792
2026-03-30 09:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0ea186eb-6f55-58e3-ba4c-bd3b2a5d41a1 with identifier: RU60792
2026-03-30 09:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0ea186eb-6f55-58e3-ba4c-bd3b2a5d41a1 with identifier: RU60792 to the API
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:10:23Z',
 'fuel_type': 'petrol',
 'id': '0ea186eb-6f55-58e3-ba4c-bd3b2a5d41a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU60792',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 261392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-06',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU60792%27 HTTP/1.1" 200 None
2026-03-30 09:07:45 [auto1.it] INFO: Saving data for RU60792: {'auction_closing_time': 1774969823.0, 'created_time': 1774343286.501737, 'last_price_update_time': 1774861665.277679}
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU60792') HTTP/1.1" 204 0
2026-03-30 09:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1162050>
2026-03-30 09:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_9a50ece33d8a6deb8e8154b262bcf43f.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_9a50ece33d8a6deb8e8154b262bcf43f.jpg saved to cache
2026-03-30 09:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21c6d778-d381-54d0-8677-1db7cd23fbba
2026-03-30 09:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_8beea7e9a8330c5c6d6bb28b328c8b6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 794a2f14-113e-5a41-992d-afae57c992fa with identifier: AS05452
2026-03-30 09:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 794a2f14-113e-5a41-992d-afae57c992fa with identifier: AS05452
2026-03-30 09:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 794a2f14-113e-5a41-992d-afae57c992fa with identifier: AS05452 to the API
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:42:40Z',
 'fuel_type': 'petrol',
 'id': '794a2f14-113e-5a41-992d-afae57c992fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS05452',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pixo',
 'odometer': 80764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-30',
 'seller_name': None,
 'title': 'Nissan Pixo 1.0 Fun/Look',
 'transmission': 'manual',
 'trim': 'Fun/Look',
 'year': 2013}
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS05452%27 HTTP/1.1" 200 None
2026-03-30 09:07:45 [auto1.it] INFO: Saving data for AS05452: {'auction_closing_time': 1774971760.0, 'created_time': 1773695246.974747, 'last_price_update_time': 1774861665.788107}
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AS05452') HTTP/1.1" 204 0
2026-03-30 09:07:45 [auto1.it] INFO: Found listing with ID: KS82343
2026-03-30 09:07:45 [auto1.it] INFO: Found listing with ID: UK67498
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK67498%27 HTTP/1.1" 200 None
2026-03-30 09:07:45 [auto1.it] INFO: Scrape type for UK67498: 2
2026-03-30 09:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4dc0c5a-783f-5314-b030-ad187586b4e0 with identifier: UK67498
2026-03-30 09:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4dc0c5a-783f-5314-b030-ad187586b4e0 with scrape type 2
2026-03-30 09:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4dc0c5a-783f-5314-b030-ad187586b4e0 with scrape type 2
2026-03-30 09:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f4dc0c5a-783f-5314-b030-ad187586b4e0, identifier: UK67498
2026-03-30 09:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_f29223f5c034e9023f906b355ba9c6bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_9126318620458683bfc7c58ec29c9012.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_19aa6dc06a7345c17368a80e09712ff5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_9b6806a8ca9b1bfcd405909b630dba18.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_e620d4e8b6bff559b3f0e4a28fa77b13.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:45 [auto1.it] INFO: Found listing with ID: AK38143
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK38143%27 HTTP/1.1" 200 None
2026-03-30 09:07:45 [auto1.it] INFO: Scrape type for AK38143: 2
2026-03-30 09:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e90d99e-4bc0-5032-9f6b-ba55f99a3f14 with identifier: AK38143
2026-03-30 09:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e90d99e-4bc0-5032-9f6b-ba55f99a3f14 with scrape type 2
2026-03-30 09:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e90d99e-4bc0-5032-9f6b-ba55f99a3f14 with scrape type 2
2026-03-30 09:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0e90d99e-4bc0-5032-9f6b-ba55f99a3f14, identifier: AK38143
2026-03-30 09:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f4dc0c5a-783f-5314-b030-ad187586b4e0 with identifier: UK67498
2026-03-30 09:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f4dc0c5a-783f-5314-b030-ad187586b4e0 with identifier: UK67498
2026-03-30 09:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f4dc0c5a-783f-5314-b030-ad187586b4e0 with identifier: UK67498 to the API
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:26:48Z',
 'fuel_type': 'diesel',
 'id': 'f4dc0c5a-783f-5314-b030-ad187586b4e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK67498',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 128723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-20',
 'seller_name': None,
 'title': 'Ford Ka 1.3 TDCi Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2011}
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK67498%27 HTTP/1.1" 200 None
2026-03-30 09:07:46 [auto1.it] INFO: Saving data for UK67498: {'auction_closing_time': 1774970808.0, 'created_time': 1773489927.427495, 'last_price_update_time': 1774861666.39001}
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK67498') HTTP/1.1" 204 0
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2706250>
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_e18d05b561994d69d11a3b99156be7db.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_e18d05b561994d69d11a3b99156be7db.jpg saved to cache
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6f2111c-ca9f-5633-834a-ea798b46fabd
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2505590>
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_1ae8b2462bb491c82a43734f72e20f39.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_1ae8b2462bb491c82a43734f72e20f39.jpg saved to cache
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6f2111c-ca9f-5633-834a-ea798b46fabd
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0f88ad0>
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_46367540d01056b537a355242935a34c.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_46367540d01056b537a355242935a34c.jpg saved to cache
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item afbb5720-7505-50aa-8f4a-f5590cc13331
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0f8a190>
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_e09c2da70461e7d212da380b7c5063ce.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e09c2da70461e7d212da380b7c5063ce.jpg saved to cache
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffb76fe2-156f-5adc-b14e-9da41f16948e
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24a7210>
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_30245fe3a7b3bd4b66e5661dbe2f99a7.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_30245fe3a7b3bd4b66e5661dbe2f99a7.jpg saved to cache
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item afbb5720-7505-50aa-8f4a-f5590cc13331
2026-03-30 09:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1375d50>
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_f91bdc1699bf4ef30800ecb0b2bc80b3.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_f91bdc1699bf4ef30800ecb0b2bc80b3.jpg saved to cache
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b6f2111c-ca9f-5633-834a-ea798b46fabd
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2506ad0>
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_bb97d78e9c592e08416c8686a794f58a.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_bb97d78e9c592e08416c8686a794f58a.jpg saved to cache
2026-03-30 09:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f619023c-88a6-5aa9-929a-dbec344354a8
2026-03-30 09:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_c3b424fe45a51a2a9754236183e14caf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0e90d99e-4bc0-5032-9f6b-ba55f99a3f14 with identifier: AK38143
2026-03-30 09:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0e90d99e-4bc0-5032-9f6b-ba55f99a3f14 with identifier: AK38143
2026-03-30 09:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0e90d99e-4bc0-5032-9f6b-ba55f99a3f14 with identifier: AK38143 to the API
2026-03-30 09:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:09:22Z',
 'fuel_type': 'petrol',
 'id': '0e90d99e-4bc0-5032-9f6b-ba55f99a3f14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK38143',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 126447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-30',
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2018}
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK38143%27 HTTP/1.1" 200 None
2026-03-30 09:07:47 [auto1.it] INFO: Saving data for AK38143: {'auction_closing_time': 1774969762.0, 'created_time': 1773270592.522419, 'last_price_update_time': 1774861667.287683}
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK38143') HTTP/1.1" 204 0
2026-03-30 09:07:47 [auto1.it] INFO: Found listing with ID: XM02393
2026-03-30 09:07:47 [auto1.it] INFO: Found listing with ID: BY67467
2026-03-30 09:07:47 [auto1.it] INFO: Found listing with ID: GZ67073
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ67073%27 HTTP/1.1" 200 None
2026-03-30 09:07:47 [auto1.it] INFO: Scrape type for GZ67073: 2
2026-03-30 09:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e565f7a-019d-59b8-8176-7ae02e822d07 with identifier: GZ67073
2026-03-30 09:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e565f7a-019d-59b8-8176-7ae02e822d07 with scrape type 2
2026-03-30 09:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e565f7a-019d-59b8-8176-7ae02e822d07 with scrape type 2
2026-03-30 09:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e565f7a-019d-59b8-8176-7ae02e822d07, identifier: GZ67073
2026-03-30 09:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_57cca1508f8a50fc717b35b346377ba2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:47 [auto1.it] INFO: Found listing with ID: SC61434
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC61434%27 HTTP/1.1" 200 None
2026-03-30 09:07:47 [auto1.it] INFO: Scrape type for SC61434: 2
2026-03-30 09:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db443d64-1492-5905-8985-ca35dbae90ae with identifier: SC61434
2026-03-30 09:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db443d64-1492-5905-8985-ca35dbae90ae with scrape type 2
2026-03-30 09:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db443d64-1492-5905-8985-ca35dbae90ae with scrape type 2
2026-03-30 09:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: db443d64-1492-5905-8985-ca35dbae90ae, identifier: SC61434
2026-03-30 09:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e565f7a-019d-59b8-8176-7ae02e822d07 with identifier: GZ67073
2026-03-30 09:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e565f7a-019d-59b8-8176-7ae02e822d07 with identifier: GZ67073
2026-03-30 09:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e565f7a-019d-59b8-8176-7ae02e822d07 with identifier: GZ67073 to the API
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:09:19Z',
 'fuel_type': 'diesel',
 'id': '2e565f7a-019d-59b8-8176-7ae02e822d07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ67073',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 230586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-04',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2010}
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ67073%27 HTTP/1.1" 200 None
2026-03-30 09:07:47 [auto1.it] INFO: Saving data for GZ67073: {'auction_closing_time': 1774969759.0, 'created_time': 1774386347.146505, 'last_price_update_time': 1774861667.957283}
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ67073') HTTP/1.1" 204 0
2026-03-30 09:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_ee8f96da332243ddacb21a73423927e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_5d2b49089295c9ba1739d5569b9c8945.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: db443d64-1492-5905-8985-ca35dbae90ae with identifier: SC61434
2026-03-30 09:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: db443d64-1492-5905-8985-ca35dbae90ae with identifier: SC61434
2026-03-30 09:07:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: db443d64-1492-5905-8985-ca35dbae90ae with identifier: SC61434 to the API
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:11:41Z',
 'fuel_type': 'diesel',
 'id': 'db443d64-1492-5905-8985-ca35dbae90ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC61434',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 78820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-10',
 'seller_name': None,
 'title': 'Fiat Tipo 1.3 M-Jet Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2020}
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC61434%27 HTTP/1.1" 200 None
2026-03-30 09:07:48 [auto1.it] INFO: Saving data for SC61434: {'auction_closing_time': 1774969901.0, 'created_time': 1774386354.719644, 'last_price_update_time': 1774861668.340596}
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC61434') HTTP/1.1" 204 0
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: CH55121
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH55121%27 HTTP/1.1" 200 None
2026-03-30 09:07:48 [auto1.it] INFO: Scrape type for CH55121: 2
2026-03-30 09:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c43a0a0-92d6-535c-affa-540e42a0e1b7 with identifier: CH55121
2026-03-30 09:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c43a0a0-92d6-535c-affa-540e42a0e1b7 with scrape type 2
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c43a0a0-92d6-535c-affa-540e42a0e1b7 with scrape type 2
2026-03-30 09:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1c43a0a0-92d6-535c-affa-540e42a0e1b7, identifier: CH55121
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee34d2ed0>
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_d3e3e1c276abccf5597327334c061e5f.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_d3e3e1c276abccf5597327334c061e5f.jpg saved to cache
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21c6d778-d381-54d0-8677-1db7cd23fbba
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11a5290>
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_8beea7e9a8330c5c6d6bb28b328c8b6d.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_8beea7e9a8330c5c6d6bb28b328c8b6d.jpg saved to cache
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21c6d778-d381-54d0-8677-1db7cd23fbba
2026-03-30 09:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1184b50>
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_f29223f5c034e9023f906b355ba9c6bb.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_f29223f5c034e9023f906b355ba9c6bb.jpg saved to cache
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d98c1aa-f077-5c28-94a2-e207e831e674
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2737d90>
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_9126318620458683bfc7c58ec29c9012.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_9126318620458683bfc7c58ec29c9012.jpg saved to cache
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21c6d778-d381-54d0-8677-1db7cd23fbba
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee144a390>
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_19aa6dc06a7345c17368a80e09712ff5.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_19aa6dc06a7345c17368a80e09712ff5.jpg saved to cache
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f619023c-88a6-5aa9-929a-dbec344354a8
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1105a90>
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_9b6806a8ca9b1bfcd405909b630dba18.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_9b6806a8ca9b1bfcd405909b630dba18.jpg saved to cache
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item afbb5720-7505-50aa-8f4a-f5590cc13331
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee144b810>
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_e620d4e8b6bff559b3f0e4a28fa77b13.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_e620d4e8b6bff559b3f0e4a28fa77b13.jpg saved to cache
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6f2111c-ca9f-5633-834a-ea798b46fabd
2026-03-30 09:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_979bd17035a6a4e0a5e23be1ec7f8daa.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_b769133860ab4d09291eb5eb7946d403.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_eaaf6fb6de25a8843df5bfc3cb3bd59e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: UH38063
2026-03-30 09:07:48 [auto1.it] INFO: Found listing with ID: EW60341
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW60341%27 HTTP/1.1" 200 None
2026-03-30 09:07:48 [auto1.it] INFO: Scrape type for EW60341: 2
2026-03-30 09:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0630bd15-798f-53ac-94ba-352edb282b71 with identifier: EW60341
2026-03-30 09:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0630bd15-798f-53ac-94ba-352edb282b71 with scrape type 2
2026-03-30 09:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0630bd15-798f-53ac-94ba-352edb282b71 with scrape type 2
2026-03-30 09:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0630bd15-798f-53ac-94ba-352edb282b71, identifier: EW60341
2026-03-30 09:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1c43a0a0-92d6-535c-affa-540e42a0e1b7 with identifier: CH55121
2026-03-30 09:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1c43a0a0-92d6-535c-affa-540e42a0e1b7 with identifier: CH55121
2026-03-30 09:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1c43a0a0-92d6-535c-affa-540e42a0e1b7 with identifier: CH55121 to the API
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:59:02Z',
 'fuel_type': 'diesel',
 'id': '1c43a0a0-92d6-535c-affa-540e42a0e1b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH55121',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 424625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-28',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2013}
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH55121%27 HTTP/1.1" 200 None
2026-03-30 09:07:49 [auto1.it] INFO: Saving data for CH55121: {'auction_closing_time': 1774972742.0, 'created_time': 1774343295.583847, 'last_price_update_time': 1774861669.363599}
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CH55121') HTTP/1.1" 204 0
2026-03-30 09:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_b3c5427339a01c74ed9e025062fe94a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_77bbf7941175868b43f2124a7ce34030.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0630bd15-798f-53ac-94ba-352edb282b71 with identifier: EW60341
2026-03-30 09:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0630bd15-798f-53ac-94ba-352edb282b71 with identifier: EW60341
2026-03-30 09:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0630bd15-798f-53ac-94ba-352edb282b71 with identifier: EW60341 to the API
2026-03-30 09:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:47:56Z',
 'fuel_type': 'petrol',
 'id': '0630bd15-798f-53ac-94ba-352edb282b71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW60341',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 93052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW60341%27 HTTP/1.1" 200 None
2026-03-30 09:07:50 [auto1.it] INFO: Saving data for EW60341: {'auction_closing_time': 1774972076.0, 'created_time': 1774440363.694733, 'last_price_update_time': 1774861670.766607}
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EW60341') HTTP/1.1" 204 0
2026-03-30 09:07:50 [auto1.it] INFO: Found listing with ID: WU93186
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU93186%27 HTTP/1.1" 200 None
2026-03-30 09:07:50 [auto1.it] INFO: Scrape type for WU93186: 2
2026-03-30 09:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89be2faf-b6f0-5e93-b1a7-f45843eb86fc with identifier: WU93186
2026-03-30 09:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89be2faf-b6f0-5e93-b1a7-f45843eb86fc with scrape type 2
2026-03-30 09:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89be2faf-b6f0-5e93-b1a7-f45843eb86fc with scrape type 2
2026-03-30 09:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 89be2faf-b6f0-5e93-b1a7-f45843eb86fc, identifier: WU93186
2026-03-30 09:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee4625110>
2026-03-30 09:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fa7%252F89a7a561488868eb903501427414fd60%252Fpa%252FBW98785_c3b424fe45a51a2a9754236183e14caf.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_c3b424fe45a51a2a9754236183e14caf.jpg saved to cache
2026-03-30 09:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffb76fe2-156f-5adc-b14e-9da41f16948e
2026-03-30 09:07:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffb76fe2-156f-5adc-b14e-9da41f16948e, skipping ID generation
2026-03-30 09:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb76fe2-156f-5adc-b14e-9da41f16948e with scrape type 1
2026-03-30 09:07:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffb76fe2-156f-5adc-b14e-9da41f16948e sending to next pipeline
2026-03-30 09:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ffb76fe2-156f-5adc-b14e-9da41f16948e, identifier: BW98785
2026-03-30 09:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12d4bd0>
2026-03-30 09:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_57cca1508f8a50fc717b35b346377ba2.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_57cca1508f8a50fc717b35b346377ba2.jpg saved to cache
2026-03-30 09:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f619023c-88a6-5aa9-929a-dbec344354a8
2026-03-30 09:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_072e4ba8800bf1360a8db1c1ed2e80a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_334766e9e5c878309c08158cc838bf06.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:51 [auto1.it] INFO: Found listing with ID: RR79124
2026-03-30 09:07:51 [auto1.it] INFO: Found listing with ID: LC66242
2026-03-30 09:07:51 [auto1.it] INFO: Found listing with ID: WX27288
2026-03-30 09:07:51 [auto1.it] INFO: Found listing with ID: EY48329
2026-03-30 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY48329%27 HTTP/1.1" 200 None
2026-03-30 09:07:51 [auto1.it] INFO: Scrape type for EY48329: 2
2026-03-30 09:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bbc3111-1cb8-5193-aa69-fec2cd30639f with identifier: EY48329
2026-03-30 09:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bbc3111-1cb8-5193-aa69-fec2cd30639f with scrape type 2
2026-03-30 09:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bbc3111-1cb8-5193-aa69-fec2cd30639f with scrape type 2
2026-03-30 09:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0bbc3111-1cb8-5193-aa69-fec2cd30639f, identifier: EY48329
2026-03-30 09:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 89be2faf-b6f0-5e93-b1a7-f45843eb86fc with identifier: WU93186
2026-03-30 09:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 89be2faf-b6f0-5e93-b1a7-f45843eb86fc with identifier: WU93186
2026-03-30 09:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 89be2faf-b6f0-5e93-b1a7-f45843eb86fc with identifier: WU93186 to the API
2026-03-30 09:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:21:17Z',
 'fuel_type': 'diesel',
 'id': '89be2faf-b6f0-5e93-b1a7-f45843eb86fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU93186',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 245687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-29',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU93186%27 HTTP/1.1" 200 None
2026-03-30 09:07:52 [auto1.it] INFO: Saving data for WU93186: {'auction_closing_time': 1774970477.0, 'created_time': 1773405279.93019, 'last_price_update_time': 1774861672.292939}
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WU93186') HTTP/1.1" 204 0
2026-03-30 09:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ffb76fe2-156f-5adc-b14e-9da41f16948e with identifier: BW98785
2026-03-30 09:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ffb76fe2-156f-5adc-b14e-9da41f16948e with identifier: BW98785
2026-03-30 09:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ffb76fe2-156f-5adc-b14e-9da41f16948e with identifier: BW98785 to the API
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_c3b424fe45a51a2a9754236183e14caf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.1L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:11:48Z',
 'fuel_type': 'diesel',
 'id': 'ffb76fe2-156f-5adc-b14e-9da41f16948e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW98785',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 172767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e452fddba8f1f3d22b819e39131d6de2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_848d36fa96ed36e9d5493fc08b698f3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_9a6d10d0a4579d48277169cac5a3508b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_414888cc1f5c647e376220257e86729a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_08709293e03908babaa1925aa56a2c61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_c0f3add9a7976b3b7bfe708ec9172fb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_69d3adba9cf18e4abb0c620d70785426.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_c3b424fe45a51a2a9754236183e14caf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e09c2da70461e7d212da380b7c5063ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffb76fe2-156f-5adc-b14e-9da41f16948e/ffb76fe2-156f-5adc-b14e-9da41f16948e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/a7/89a7a561488868eb903501427414fd60/pa/BW98785_e86916f22fc587298331320b8d6d3a1b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 d 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2016}
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW98785%27 HTTP/1.1" 200 None
2026-03-30 09:07:53 [auto1.it] INFO: Saving data for BW98785: {'created_time': 1774861673.104504, 'last_price_update_time': 1774861673.104518, 'auction_closing_time': 1774969908.0}
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BW98785') HTTP/1.1" 204 0
2026-03-30 09:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_bda00fa9740fba6628788292cfe6b366.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0bbc3111-1cb8-5193-aa69-fec2cd30639f with identifier: EY48329
2026-03-30 09:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0bbc3111-1cb8-5193-aa69-fec2cd30639f with identifier: EY48329
2026-03-30 09:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0bbc3111-1cb8-5193-aa69-fec2cd30639f with identifier: EY48329 to the API
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:35:14Z',
 'fuel_type': 'diesel',
 'id': '0bbc3111-1cb8-5193-aa69-fec2cd30639f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY48329',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 332067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2015}
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY48329%27 HTTP/1.1" 200 None
2026-03-30 09:07:53 [auto1.it] INFO: Saving data for EY48329: {'auction_closing_time': 1774971314.0, 'created_time': 1773435927.550709, 'last_price_update_time': 1774861673.562391}
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EY48329') HTTP/1.1" 204 0
2026-03-30 09:07:53 [auto1.it] INFO: Found listing with ID: SH29358
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH29358%27 HTTP/1.1" 200 None
2026-03-30 09:07:53 [auto1.it] INFO: Scrape type for SH29358: 2
2026-03-30 09:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26a9504c-47cc-5b67-b4df-c95ba67311dc with identifier: SH29358
2026-03-30 09:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26a9504c-47cc-5b67-b4df-c95ba67311dc with scrape type 2
2026-03-30 09:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26a9504c-47cc-5b67-b4df-c95ba67311dc with scrape type 2
2026-03-30 09:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26a9504c-47cc-5b67-b4df-c95ba67311dc, identifier: SH29358
2026-03-30 09:07:53 [auto1.it] INFO: Found listing with ID: FY08394
2026-03-30 09:07:53 [auto1.it] INFO: Found listing with ID: RU39980
2026-03-30 09:07:53 [auto1.it] INFO: Found listing with ID: HW76597
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW76597%27 HTTP/1.1" 200 None
2026-03-30 09:07:53 [auto1.it] INFO: Scrape type for HW76597: 2
2026-03-30 09:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe254258-e2b5-58bf-92ea-179e080487d4 with identifier: HW76597
2026-03-30 09:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe254258-e2b5-58bf-92ea-179e080487d4 with scrape type 2
2026-03-30 09:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe254258-e2b5-58bf-92ea-179e080487d4 with scrape type 2
2026-03-30 09:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fe254258-e2b5-58bf-92ea-179e080487d4, identifier: HW76597
2026-03-30 09:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26a9504c-47cc-5b67-b4df-c95ba67311dc with identifier: SH29358
2026-03-30 09:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26a9504c-47cc-5b67-b4df-c95ba67311dc with identifier: SH29358
2026-03-30 09:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26a9504c-47cc-5b67-b4df-c95ba67311dc with identifier: SH29358 to the API
2026-03-30 09:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:57:05Z',
 'fuel_type': 'diesel',
 'id': '26a9504c-47cc-5b67-b4df-c95ba67311dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH29358',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 101654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-26',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH29358%27 HTTP/1.1" 200 None
2026-03-30 09:07:54 [auto1.it] INFO: Saving data for SH29358: {'auction_closing_time': 1774972625.0, 'created_time': 1773954470.72831, 'last_price_update_time': 1774861674.277129}
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SH29358') HTTP/1.1" 204 0
2026-03-30 09:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT54121/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW32826> (referer: https://www.auto1.com/v1/car-details-view/YW32826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12d4550>
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_ee8f96da332243ddacb21a73423927e1.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_ee8f96da332243ddacb21a73423927e1.jpg saved to cache
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f619023c-88a6-5aa9-929a-dbec344354a8
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48d7210>
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_5d2b49089295c9ba1739d5569b9c8945.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_5d2b49089295c9ba1739d5569b9c8945.jpg saved to cache
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21c6d778-d381-54d0-8677-1db7cd23fbba
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fd6d10>
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_979bd17035a6a4e0a5e23be1ec7f8daa.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_979bd17035a6a4e0a5e23be1ec7f8daa.jpg saved to cache
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f619023c-88a6-5aa9-929a-dbec344354a8
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee116ead0>
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_b769133860ab4d09291eb5eb7946d403.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_b769133860ab4d09291eb5eb7946d403.jpg saved to cache
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b6f2111c-ca9f-5633-834a-ea798b46fabd
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1264c10>
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe410b0ab2bcf3d9b5d723e3d62839bde%252Fpa%252FCW23076_eaaf6fb6de25a8843df5bfc3cb3bd59e.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_eaaf6fb6de25a8843df5bfc3cb3bd59e.jpg saved to cache
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21c6d778-d381-54d0-8677-1db7cd23fbba
2026-03-30 09:07:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21c6d778-d381-54d0-8677-1db7cd23fbba, skipping ID generation
2026-03-30 09:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21c6d778-d381-54d0-8677-1db7cd23fbba with scrape type 1
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21c6d778-d381-54d0-8677-1db7cd23fbba sending to next pipeline
2026-03-30 09:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 21c6d778-d381-54d0-8677-1db7cd23fbba, identifier: CW23076
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25eaad0>
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Fee%252Fc3ee6db914438ac8e192b671a08c1a0d%252Fpa%252FDW47560_b3c5427339a01c74ed9e025062fe94a5.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_b3c5427339a01c74ed9e025062fe94a5.jpg saved to cache
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f619023c-88a6-5aa9-929a-dbec344354a8
2026-03-30 09:07:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f619023c-88a6-5aa9-929a-dbec344354a8, skipping ID generation
2026-03-30 09:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f619023c-88a6-5aa9-929a-dbec344354a8 with scrape type 1
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f619023c-88a6-5aa9-929a-dbec344354a8 sending to next pipeline
2026-03-30 09:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f619023c-88a6-5aa9-929a-dbec344354a8, identifier: DW47560
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24f8050>
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fd3%252F2bd3050e3ee6102e46519473ee6f6ea5%252Fpa%252FYV17911_77bbf7941175868b43f2124a7ce34030.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_77bbf7941175868b43f2124a7ce34030.jpg saved to cache
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6f2111c-ca9f-5633-834a-ea798b46fabd
2026-03-30 09:07:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6f2111c-ca9f-5633-834a-ea798b46fabd, skipping ID generation
2026-03-30 09:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f2111c-ca9f-5633-834a-ea798b46fabd with scrape type 1
2026-03-30 09:07:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6f2111c-ca9f-5633-834a-ea798b46fabd sending to next pipeline
2026-03-30 09:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b6f2111c-ca9f-5633-834a-ea798b46fabd, identifier: YV17911
2026-03-30 09:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_6162bf23eb329794aed8360b2c3b9bed.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_dd904135a643d4e557a9775580a62629.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_fe991f5b7184683f25bb4b705d568a5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fe254258-e2b5-58bf-92ea-179e080487d4 with identifier: HW76597
2026-03-30 09:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fe254258-e2b5-58bf-92ea-179e080487d4 with identifier: HW76597
2026-03-30 09:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fe254258-e2b5-58bf-92ea-179e080487d4 with identifier: HW76597 to the API
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:11:26Z',
 'fuel_type': 'hybrid',
 'id': 'fe254258-e2b5-58bf-92ea-179e080487d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW76597',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 66661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Lounge',
 'transmission': 'automatic',
 'trim': '2WD Lounge',
 'year': 2022}
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW76597%27 HTTP/1.1" 200 None
2026-03-30 09:07:55 [auto1.it] INFO: Saving data for HW76597: {'auction_closing_time': 1774969886.0, 'created_time': 1774472825.698832, 'last_price_update_time': 1774861675.270353}
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW76597') HTTP/1.1" 204 0
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: NK12319
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: VY18812
2026-03-30 09:07:55 [auto1.it] INFO: Found listing with ID: EZ69739
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ69739%27 HTTP/1.1" 200 None
2026-03-30 09:07:55 [auto1.it] INFO: Scrape type for EZ69739: 2
2026-03-30 09:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3aec6153-ff79-57d8-a42e-cccd6340b06c with identifier: EZ69739
2026-03-30 09:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aec6153-ff79-57d8-a42e-cccd6340b06c with scrape type 2
2026-03-30 09:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3aec6153-ff79-57d8-a42e-cccd6340b06c with scrape type 2
2026-03-30 09:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3aec6153-ff79-57d8-a42e-cccd6340b06c, identifier: EZ69739
2026-03-30 09:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 21c6d778-d381-54d0-8677-1db7cd23fbba with identifier: CW23076
2026-03-30 09:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 21c6d778-d381-54d0-8677-1db7cd23fbba with identifier: CW23076
2026-03-30 09:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 21c6d778-d381-54d0-8677-1db7cd23fbba with identifier: CW23076 to the API
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_eaaf6fb6de25a8843df5bfc3cb3bd59e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 109,
 'expiration_date': '2026-03-31T15:42:42Z',
 'fuel_type': 'gas',
 'id': '21c6d778-d381-54d0-8677-1db7cd23fbba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW23076',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 83447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_65f774dd6a4dbc1c6666bf276cd1c39e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_8beea7e9a8330c5c6d6bb28b328c8b6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_617e4e04859a1cc400204cc01f134b6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_5eba2f1b288e4ce418df990e312426a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_f7a1c9e8854be474eec515f524a6cc6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_9a50ece33d8a6deb8e8154b262bcf43f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_d3e3e1c276abccf5597327334c061e5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_eaaf6fb6de25a8843df5bfc3cb3bd59e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_9126318620458683bfc7c58ec29c9012.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c6d778-d381-54d0-8677-1db7cd23fbba/21c6d778-d381-54d0-8677-1db7cd23fbba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e410b0ab2bcf3d9b5d723e3d62839bde/pa/CW23076_5d2b49089295c9ba1739d5569b9c8945.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Dacia Dokker 1.6 SCe Benzin / LPG Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2020}
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW23076%27 HTTP/1.1" 200 None
2026-03-30 09:07:55 [auto1.it] INFO: Saving data for CW23076: {'created_time': 1774861675.818102, 'last_price_update_time': 1774861675.818117, 'auction_closing_time': 1774971762.0}
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CW23076') HTTP/1.1" 204 0
2026-03-30 09:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f619023c-88a6-5aa9-929a-dbec344354a8 with identifier: DW47560
2026-03-30 09:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f619023c-88a6-5aa9-929a-dbec344354a8 with identifier: DW47560
2026-03-30 09:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f619023c-88a6-5aa9-929a-dbec344354a8 with identifier: DW47560 to the API
2026-03-30 09:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_b3c5427339a01c74ed9e025062fe94a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.4L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:45:42Z',
 'fuel_type': 'diesel',
 'id': 'f619023c-88a6-5aa9-929a-dbec344354a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW47560',
 'listing': 'auction',
 'location': "IT, Santa Vittoria D'Alba",
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 337224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_5caaf67dc15835d39282e56f49571163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_bc2e0cc3e461d8021d37386effd5f276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_c638cf11c22ef9fc592c3ef0638e98e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_afea595dee97d3dc7459d90438366207.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_19aa6dc06a7345c17368a80e09712ff5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_bb97d78e9c592e08416c8686a794f58a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_ee8f96da332243ddacb21a73423927e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_57cca1508f8a50fc717b35b346377ba2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_979bd17035a6a4e0a5e23be1ec7f8daa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f619023c-88a6-5aa9-929a-dbec344354a8/f619023c-88a6-5aa9-929a-dbec344354a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/ee/c3ee6db914438ac8e192b671a08c1a0d/pa/DW47560_b3c5427339a01c74ed9e025062fe94a5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC70 2.4 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2010}
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW47560%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Saving data for DW47560: {'created_time': 1774861676.239986, 'last_price_update_time': 1774861676.239998, 'auction_closing_time': 1774971942.0}
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW47560') HTTP/1.1" 204 0
2026-03-30 09:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b6f2111c-ca9f-5633-834a-ea798b46fabd with identifier: YV17911
2026-03-30 09:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b6f2111c-ca9f-5633-834a-ea798b46fabd with identifier: YV17911
2026-03-30 09:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b6f2111c-ca9f-5633-834a-ea798b46fabd with identifier: YV17911 to the API
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_77bbf7941175868b43f2124a7ce34030.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:08:19Z',
 'fuel_type': 'diesel',
 'id': 'b6f2111c-ca9f-5633-834a-ea798b46fabd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV17911',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 95299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_c4dc4733e408d5d7f0c5e9572ae1d368.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_77bbf7941175868b43f2124a7ce34030.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_dd5a6b138598bf7f26cc485c42dbabc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_1bdd266db3bf9133fcfe6c06276ae0ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_3cdb2ecd7940cda2ce2395f3863e93df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_e18d05b561994d69d11a3b99156be7db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_1ae8b2462bb491c82a43734f72e20f39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_e620d4e8b6bff559b3f0e4a28fa77b13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_f91bdc1699bf4ef30800ecb0b2bc80b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f2111c-ca9f-5633-834a-ea798b46fabd/b6f2111c-ca9f-5633-834a-ea798b46fabd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/d3/2bd3050e3ee6102e46519473ee6f6ea5/pa/YV17911_b769133860ab4d09291eb5eb7946d403.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.3 JTD Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2014}
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV17911%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Saving data for YV17911: {'created_time': 1774861676.676083, 'last_price_update_time': 1774861676.676098, 'auction_closing_time': 1774969699.0}
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YV17911') HTTP/1.1" 204 0
2026-03-30 09:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_c6101778e03ebaf463cc3b4a7357bf35.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_e103fb3208626321a312eaf0b2af9694.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:07:56 [auto1.it] INFO: Found listing with ID: BV54558
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV54558%27 HTTP/1.1" 200 None
2026-03-30 09:07:56 [auto1.it] INFO: Scrape type for BV54558: 2
2026-03-30 09:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88547a48-b822-5f29-ab0b-d86beb1fb055 with identifier: BV54558
2026-03-30 09:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88547a48-b822-5f29-ab0b-d86beb1fb055 with scrape type 2
2026-03-30 09:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88547a48-b822-5f29-ab0b-d86beb1fb055 with scrape type 2
2026-03-30 09:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 88547a48-b822-5f29-ab0b-d86beb1fb055, identifier: BV54558
2026-03-30 09:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3aec6153-ff79-57d8-a42e-cccd6340b06c with identifier: EZ69739
2026-03-30 09:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3aec6153-ff79-57d8-a42e-cccd6340b06c with identifier: EZ69739
2026-03-30 09:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3aec6153-ff79-57d8-a42e-cccd6340b06c with identifier: EZ69739 to the API
2026-03-30 09:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:07:40Z',
 'fuel_type': 'diesel',
 'id': '3aec6153-ff79-57d8-a42e-cccd6340b06c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ69739',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 232841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-01',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2010}
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ69739%27 HTTP/1.1" 200 None
2026-03-30 09:07:57 [auto1.it] INFO: Saving data for EZ69739: {'auction_closing_time': 1774969660.0, 'created_time': 1773136056.536957, 'last_price_update_time': 1774861677.172748}
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ69739') HTTP/1.1" 204 0
2026-03-30 09:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN01544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24f8b10>
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_072e4ba8800bf1360a8db1c1ed2e80a8.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_072e4ba8800bf1360a8db1c1ed2e80a8.jpg saved to cache
2026-03-30 09:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afbb5720-7505-50aa-8f4a-f5590cc13331
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24f9350>
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F26%252Fec268aa7aec20029a989d00592c72124%252Fpa%252FKB21733_334766e9e5c878309c08158cc838bf06.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_334766e9e5c878309c08158cc838bf06.jpg saved to cache
2026-03-30 09:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afbb5720-7505-50aa-8f4a-f5590cc13331
2026-03-30 09:07:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afbb5720-7505-50aa-8f4a-f5590cc13331, skipping ID generation
2026-03-30 09:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afbb5720-7505-50aa-8f4a-f5590cc13331 with scrape type 1
2026-03-30 09:07:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afbb5720-7505-50aa-8f4a-f5590cc13331 sending to next pipeline
2026-03-30 09:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: afbb5720-7505-50aa-8f4a-f5590cc13331, identifier: KB21733
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee281d7d0>
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9/0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5b%252Fa85bc7415191c842746e57db8f5238e3%252Fpa%252FRP34917_bda00fa9740fba6628788292cfe6b366.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_bda00fa9740fba6628788292cfe6b366.jpg saved to cache
2026-03-30 09:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9
2026-03-30 09:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 88547a48-b822-5f29-ab0b-d86beb1fb055 with identifier: BV54558
2026-03-30 09:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 88547a48-b822-5f29-ab0b-d86beb1fb055 with identifier: BV54558
2026-03-30 09:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 88547a48-b822-5f29-ab0b-d86beb1fb055 with identifier: BV54558 to the API
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:46:22Z',
 'fuel_type': 'diesel',
 'id': '88547a48-b822-5f29-ab0b-d86beb1fb055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV54558',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 165972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L1 Luxury',
 'transmission': 'automatic',
 'trim': 'L1 Luxury',
 'year': 2017}
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV54558%27 HTTP/1.1" 200 None
2026-03-30 09:07:57 [auto1.it] INFO: Saving data for BV54558: {'auction_closing_time': 1774971982.0, 'created_time': 1774447526.454822, 'last_price_update_time': 1774861677.805349}
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BV54558') HTTP/1.1" 204 0
2026-03-30 09:07:57 [auto1.it] INFO: Found listing with ID: ZX52658
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX52658%27 HTTP/1.1" 200 None
2026-03-30 09:07:57 [auto1.it] INFO: Scrape type for ZX52658: 2
2026-03-30 09:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2836beef-db24-5c3c-8146-9801bd2cfb4b with identifier: ZX52658
2026-03-30 09:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2836beef-db24-5c3c-8146-9801bd2cfb4b with scrape type 2
2026-03-30 09:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2836beef-db24-5c3c-8146-9801bd2cfb4b with scrape type 2
2026-03-30 09:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2836beef-db24-5c3c-8146-9801bd2cfb4b, identifier: ZX52658
2026-03-30 09:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU05925> (referer: https://www.auto1.com/v1/car-details-view/YU05925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: afbb5720-7505-50aa-8f4a-f5590cc13331 with identifier: KB21733
2026-03-30 09:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: afbb5720-7505-50aa-8f4a-f5590cc13331 with identifier: KB21733
2026-03-30 09:07:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: afbb5720-7505-50aa-8f4a-f5590cc13331 with identifier: KB21733 to the API
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_334766e9e5c878309c08158cc838bf06.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:02:40Z',
 'fuel_type': 'diesel',
 'id': 'afbb5720-7505-50aa-8f4a-f5590cc13331',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB21733',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'BMW',
 'model': '1er',
 'odometer': 58687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_d9069787cfe356422f06a66e66e4f9e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_1a575d2453db8e583aae55b26cca27e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_072e4ba8800bf1360a8db1c1ed2e80a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_334766e9e5c878309c08158cc838bf06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_ad2abce50ade4f1ac8d0d12f50981c0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_4bec2271ba2036d36d3fc6be0ce3608a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_714f4216d940c0d66803d79849b57314.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_30245fe3a7b3bd4b66e5661dbe2f99a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_46367540d01056b537a355242935a34c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afbb5720-7505-50aa-8f4a-f5590cc13331/afbb5720-7505-50aa-8f4a-f5590cc13331_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/26/ec268aa7aec20029a989d00592c72124/pa/KB21733_9b6806a8ca9b1bfcd405909b630dba18.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB21733%27 HTTP/1.1" 200 None
2026-03-30 09:07:58 [auto1.it] INFO: Saving data for KB21733: {'created_time': 1774861678.375741, 'last_price_update_time': 1774861678.375752, 'auction_closing_time': 1774969360.0}
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KB21733') HTTP/1.1" 204 0
2026-03-30 09:07:58 [auto1.it] INFO: Found listing with ID: NL09316
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL09316%27 HTTP/1.1" 200 None
2026-03-30 09:07:58 [auto1.it] INFO: Scrape type for NL09316: 2
2026-03-30 09:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13da95af-9dc5-549b-bde8-470f7831738a with identifier: NL09316
2026-03-30 09:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13da95af-9dc5-549b-bde8-470f7831738a with scrape type 2
2026-03-30 09:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13da95af-9dc5-549b-bde8-470f7831738a with scrape type 2
2026-03-30 09:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 13da95af-9dc5-549b-bde8-470f7831738a, identifier: NL09316
2026-03-30 09:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2836beef-db24-5c3c-8146-9801bd2cfb4b with identifier: ZX52658
2026-03-30 09:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2836beef-db24-5c3c-8146-9801bd2cfb4b with identifier: ZX52658
2026-03-30 09:07:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2836beef-db24-5c3c-8146-9801bd2cfb4b with identifier: ZX52658 to the API
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:19:45Z',
 'fuel_type': 'diesel',
 'id': '2836beef-db24-5c3c-8146-9801bd2cfb4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX52658',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C-Crosser',
 'odometer': 295886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-10',
 'seller_name': None,
 'title': 'Citroen C-Crosser 2.2 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX52658%27 HTTP/1.1" 200 None
2026-03-30 09:07:58 [auto1.it] INFO: Saving data for ZX52658: {'auction_closing_time': 1774970385.0, 'created_time': 1773236625.696408, 'last_price_update_time': 1774861678.826299}
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX52658') HTTP/1.1" 204 0
2026-03-30 09:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS01287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 13da95af-9dc5-549b-bde8-470f7831738a with identifier: NL09316
2026-03-30 09:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 13da95af-9dc5-549b-bde8-470f7831738a with identifier: NL09316
2026-03-30 09:07:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 13da95af-9dc5-549b-bde8-470f7831738a with identifier: NL09316 to the API
2026-03-30 09:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:19:21Z',
 'fuel_type': 'diesel',
 'id': '13da95af-9dc5-549b-bde8-470f7831738a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL09316',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 215985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-18',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2018}
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL09316%27 HTTP/1.1" 200 None
2026-03-30 09:07:59 [auto1.it] INFO: Saving data for NL09316: {'auction_closing_time': 1774970361.0, 'created_time': 1774440353.099672, 'last_price_update_time': 1774861679.206465}
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NL09316') HTTP/1.1" 204 0
2026-03-30 09:07:59 [auto1.it] INFO: Found listing with ID: LY23963
2026-03-30 09:07:59 [auto1.it] INFO: Found listing with ID: KC02263
2026-03-30 09:07:59 [auto1.it] INFO: Found listing with ID: YZ93914
2026-03-30 09:07:59 [auto1.it] INFO: Found listing with ID: VR96583
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR96583%27 HTTP/1.1" 200 None
2026-03-30 09:07:59 [auto1.it] INFO: Scrape type for VR96583: 1
2026-03-30 09:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF93411> (referer: https://www.auto1.com/v1/car-details-view/TF93411/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 934ada02-42ab-57af-9973-0095223d0312 with identifier: YW32826
2026-03-30 09:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 934ada02-42ab-57af-9973-0095223d0312 with scrape type 1
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 934ada02-42ab-57af-9973-0095223d0312
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7c%252Fd07ce05ba6253d1b2820e54b1bf3052c%252Fpa%252FYW32826_7116a3898e09f0bee3e3a8f79b0a86d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_7116a3898e09f0bee3e3a8f79b0a86d1.jpg already downloaded
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7c%252Fd07ce05ba6253d1b2820e54b1bf3052c%252Fpa%252FYW32826_5b9f374ccbc09362e810746afe80150a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_5b9f374ccbc09362e810746afe80150a.jpg already downloaded
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7c%252Fd07ce05ba6253d1b2820e54b1bf3052c%252Fpa%252FYW32826_468462b4076bcc629f607c78d4f7517e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_468462b4076bcc629f607c78d4f7517e.jpg already downloaded
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7c%252Fd07ce05ba6253d1b2820e54b1bf3052c%252Fpa%252FYW32826_0838aa7d9630ff187bc844e1245ee251.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_0838aa7d9630ff187bc844e1245ee251.jpg already downloaded
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F7c%252Fd07ce05ba6253d1b2820e54b1bf3052c%252Fpa%252FYW32826_377dba5f2616626ed29b1eedf30b7b3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_377dba5f2616626ed29b1eedf30b7b3a.jpg already downloaded
2026-03-30 09:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 934ada02-42ab-57af-9973-0095223d0312, identifier: YW32826
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fbbd10>
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330/c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F82%252F8082c638323a907eab007a71a0125a2c%252Fpa%252FRJ74890_6162bf23eb329794aed8360b2c3b9bed.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_6162bf23eb329794aed8360b2c3b9bed.jpg saved to cache
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10baf10>
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fc3%252F62c3621650f44bf0665afb4e5540bf2c%252Fpa%252FRV38017_dd904135a643d4e557a9775580a62629.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_dd904135a643d4e557a9775580a62629.jpg saved to cache
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5
2026-03-30 09:07:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5, skipping ID generation
2026-03-30 09:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5 with scrape type 1
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5 sending to next pipeline
2026-03-30 09:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5, identifier: RV38017
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee128fc10>
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9/0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F5b%252Fa85bc7415191c842746e57db8f5238e3%252Fpa%252FRP34917_fe991f5b7184683f25bb4b705d568a5a.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_fe991f5b7184683f25bb4b705d568a5a.jpg saved to cache
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9
2026-03-30 09:07:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9, skipping ID generation
2026-03-30 09:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9 with scrape type 1
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9 sending to next pipeline
2026-03-30 09:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9, identifier: RP34917
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1442490>
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F58%252F7458036ce7d2f1d0c28ad2a24066b226%252Fpa%252FFK67266_c6101778e03ebaf463cc3b4a7357bf35.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_c6101778e03ebaf463cc3b4a7357bf35.jpg saved to cache
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d98c1aa-f077-5c28-94a2-e207e831e674
2026-03-30 09:07:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d98c1aa-f077-5c28-94a2-e207e831e674, skipping ID generation
2026-03-30 09:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d98c1aa-f077-5c28-94a2-e207e831e674 with scrape type 1
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d98c1aa-f077-5c28-94a2-e207e831e674 sending to next pipeline
2026-03-30 09:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7d98c1aa-f077-5c28-94a2-e207e831e674, identifier: FK67266
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1453c90>
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330/c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F82%252F8082c638323a907eab007a71a0125a2c%252Fpa%252FRJ74890_e103fb3208626321a312eaf0b2af9694.jpg') HTTP/1.1" 204 0
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_e103fb3208626321a312eaf0b2af9694.jpg saved to cache
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330
2026-03-30 09:07:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330, skipping ID generation
2026-03-30 09:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330 with scrape type 1
2026-03-30 09:07:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330 sending to next pipeline
2026-03-30 09:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330, identifier: RJ74890
2026-03-30 09:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 934ada02-42ab-57af-9973-0095223d0312 with identifier: YW32826
2026-03-30 09:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 934ada02-42ab-57af-9973-0095223d0312 with identifier: YW32826
2026-03-30 09:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 934ada02-42ab-57af-9973-0095223d0312 with identifier: YW32826 to the API
2026-03-30 09:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YW32826>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:40:32Z',
 'fuel_type': 'petrol',
 'id': '934ada02-42ab-57af-9973-0095223d0312',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW32826',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 162477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_7116a3898e09f0bee3e3a8f79b0a86d1.jpg',
                'https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_5b9f374ccbc09362e810746afe80150a.jpg',
                'https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_468462b4076bcc629f607c78d4f7517e.jpg',
                'https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_0838aa7d9630ff187bc844e1245ee251.jpg',
                'https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_377dba5f2616626ed29b1eedf30b7b3a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934ada02-42ab-57af-9973-0095223d0312/934ada02-42ab-57af-9973-0095223d0312_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_7116a3898e09f0bee3e3a8f79b0a86d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934ada02-42ab-57af-9973-0095223d0312/934ada02-42ab-57af-9973-0095223d0312_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_5b9f374ccbc09362e810746afe80150a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934ada02-42ab-57af-9973-0095223d0312/934ada02-42ab-57af-9973-0095223d0312_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_468462b4076bcc629f607c78d4f7517e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934ada02-42ab-57af-9973-0095223d0312/934ada02-42ab-57af-9973-0095223d0312_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_0838aa7d9630ff187bc844e1245ee251.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_934ada02-42ab-57af-9973-0095223d0312/934ada02-42ab-57af-9973-0095223d0312_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/7c/d07ce05ba6253d1b2820e54b1bf3052c/pa/YW32826_377dba5f2616626ed29b1eedf30b7b3a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW32826%27 HTTP/1.1" 200 None
2026-03-30 09:08:00 [auto1.it] INFO: Saving data for YW32826: {'created_time': 1774861680.432723, 'last_price_update_time': 1774861680.432735, 'auction_closing_time': 1774971632.0}
2026-03-30 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YW32826') HTTP/1.1" 204 0
2026-03-30 09:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5 with identifier: RV38017
2026-03-30 09:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5 with identifier: RV38017
2026-03-30 09:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5 with identifier: RV38017 to the API
2026-03-30 09:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_dd904135a643d4e557a9775580a62629.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:50:00Z',
 'fuel_type': 'petrol',
 'id': '0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV38017',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 150580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_9fd1d3f67c4894cf251b1daea4544371.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_d05a4570144da7450b88e4197314495a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_1eec34761ceeba8cb08758945e3548eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_8aefbd8021d3704774d6943c03a3d06e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_ccb3a5037af7c92e4c7a23d1aa0eda9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_4d38802a66cce1484536c6a9d48e2806.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_4678ad9eb9a316f24f2d34f14d391864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_55cf50d63881e430e724307e92dbc82e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_3930e107e8a98ccfb2508dcc2b394b44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5/0c16fbc1-3a42-55a3-aa3c-2a39bf3126d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/c3/62c3621650f44bf0665afb4e5540bf2c/pa/RV38017_dd904135a643d4e557a9775580a62629.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2011}
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV38017%27 HTTP/1.1" 200 None
2026-03-30 09:08:01 [auto1.it] INFO: Saving data for RV38017: {'created_time': 1774861681.17296, 'last_price_update_time': 1774861681.172972, 'auction_closing_time': 1774972200.0}
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RV38017') HTTP/1.1" 204 0
2026-03-30 09:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9 with identifier: RP34917
2026-03-30 09:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9 with identifier: RP34917
2026-03-30 09:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9 with identifier: RP34917 to the API
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_fe991f5b7184683f25bb4b705d568a5a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:16:21Z',
 'fuel_type': 'petrol',
 'id': '0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP34917',
 'listing': 'auction',
 'location': 'IT, Brescia',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 161612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9/0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_ece037bbdc2798d6ddfdebec80a841e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9/0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_72a9b0c4bfb9e6a526c11e364bda2f3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9/0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_fe991f5b7184683f25bb4b705d568a5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9/0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_bda00fa9740fba6628788292cfe6b366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9/0f4f2c85-9a1d-57ac-a519-6ef39e4db5b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/5b/a85bc7415191c842746e57db8f5238e3/pa/RP34917_4919f112480e577ffb496da129a02e43.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2012}
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP34917%27 HTTP/1.1" 200 None
2026-03-30 09:08:01 [auto1.it] INFO: Saving data for RP34917: {'created_time': 1774861681.594311, 'last_price_update_time': 1774861681.594322, 'auction_closing_time': 1774970181.0}
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RP34917') HTTP/1.1" 204 0
2026-03-30 09:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7d98c1aa-f077-5c28-94a2-e207e831e674 with identifier: FK67266
2026-03-30 09:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7d98c1aa-f077-5c28-94a2-e207e831e674 with identifier: FK67266
2026-03-30 09:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7d98c1aa-f077-5c28-94a2-e207e831e674 with identifier: FK67266 to the API
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_c6101778e03ebaf463cc3b4a7357bf35.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:39:23Z',
 'fuel_type': 'diesel',
 'id': '7d98c1aa-f077-5c28-94a2-e207e831e674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK67266',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 24981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_c6101778e03ebaf463cc3b4a7357bf35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_8e5a13d9f8a971ddeea4fb455d1db3a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_2d1413bf8bbd43d707bd41f7debc5fb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_7450d497a3086031a703790e3d24a255.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_d60e39ecd3243c4e82acfb10103eae39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_81de64171288e458f7fda6fb2f0fe993.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_5affe906167f6d024a902ce08af59642.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_f4835b2db4683e8fe3406874ebdf6020.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_94d7687a5c30202bf26d564113eee8ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d98c1aa-f077-5c28-94a2-e207e831e674/7d98c1aa-f077-5c28-94a2-e207e831e674_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/58/7458036ce7d2f1d0c28ad2a24066b226/pa/FK67266_f29223f5c034e9023f906b355ba9c6bb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2024}
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK67266%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Saving data for FK67266: {'created_time': 1774861682.18485, 'last_price_update_time': 1774861682.184863, 'auction_closing_time': 1774971563.0}
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FK67266') HTTP/1.1" 204 0
2026-03-30 09:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330 with identifier: RJ74890
2026-03-30 09:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330 with identifier: RJ74890
2026-03-30 09:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330 with identifier: RJ74890 to the API
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_e103fb3208626321a312eaf0b2af9694.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:23:36Z',
 'fuel_type': 'petrol',
 'id': 'c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ74890',
 'listing': 'auction',
 'location': 'IT, Modena',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 202300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330/c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_e103fb3208626321a312eaf0b2af9694.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330/c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_6162bf23eb329794aed8360b2c3b9bed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330/c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_e4b51390397fb825d81fe677aa661dca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330/c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_cc8017b2fa91ecf20f9fd309dd98bf83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330/c76a8d2b-6d6d-54fb-9f1b-ed1f913cd330_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/82/8082c638323a907eab007a71a0125a2c/pa/RJ74890_2fa0cd33a347676269579fa85ba33a4c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Bravo 1.4 Dynamic GPL',
 'transmission': 'manual',
 'trim': 'Dynamic GPL',
 'year': 2009}
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ74890%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Saving data for RJ74890: {'created_time': 1774861682.699321, 'last_price_update_time': 1774861682.699333, 'auction_closing_time': 1774970616.0}
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RJ74890') HTTP/1.1" 204 0
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: GT94067
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: PK23396
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: VY79198
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: PS15359
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: LZ12908
2026-03-30 09:08:02 [auto1.it] INFO: Found listing with ID: CZ74992
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ74992%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [auto1.it] INFO: Scrape type for CZ74992: 2
2026-03-30 09:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ef53765-4800-5f02-95ea-a373668217f4 with identifier: CZ74992
2026-03-30 09:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ef53765-4800-5f02-95ea-a373668217f4 with scrape type 2
2026-03-30 09:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ef53765-4800-5f02-95ea-a373668217f4 with scrape type 2
2026-03-30 09:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ef53765-4800-5f02-95ea-a373668217f4, identifier: CZ74992
2026-03-30 09:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:02 [auto1.it] INFO: Channel: 24h | Page: 10 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc6d9507-2023-5d5a-993a-6ad61a39875a with identifier: YU05925
2026-03-30 09:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc6d9507-2023-5d5a-993a-6ad61a39875a with scrape type 1
2026-03-30 09:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc6d9507-2023-5d5a-993a-6ad61a39875a
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcb%252F70cb13e5e4265e51bbfe6f2a96395c52%252Fpa%252FYU05925_cb21b9d156b74298b6f0e71d3267f6a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_cb21b9d156b74298b6f0e71d3267f6a4.jpg already downloaded
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcb%252F70cb13e5e4265e51bbfe6f2a96395c52%252Fpa%252FYU05925_502b54ee43c9f40430ace774767ce600.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_502b54ee43c9f40430ace774767ce600.jpg already downloaded
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcb%252F70cb13e5e4265e51bbfe6f2a96395c52%252Fpa%252FYU05925_43dd090d535e7fe65ae21be3d8aff96b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_43dd090d535e7fe65ae21be3d8aff96b.jpg already downloaded
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcb%252F70cb13e5e4265e51bbfe6f2a96395c52%252Fpa%252FYU05925_39021524546851fc8fac83aff0aa2b4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_39021524546851fc8fac83aff0aa2b4f.jpg already downloaded
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcb%252F70cb13e5e4265e51bbfe6f2a96395c52%252Fpa%252FYU05925_3d5421e12907d187f85444b9a95707e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_3d5421e12907d187f85444b9a95707e5.jpg already downloaded
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcb%252F70cb13e5e4265e51bbfe6f2a96395c52%252Fpa%252FYU05925_86856b03902597ea8a4caf4b1141fdfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_86856b03902597ea8a4caf4b1141fdfa.jpg already downloaded
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcb%252F70cb13e5e4265e51bbfe6f2a96395c52%252Fpa%252FYU05925_573d58733286859d891f6a585f70f5d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_573d58733286859d891f6a585f70f5d6.jpg already downloaded
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcb%252F70cb13e5e4265e51bbfe6f2a96395c52%252Fpa%252FYU05925_e22a500f81e7a020cf7b129e3dbe70a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_e22a500f81e7a020cf7b129e3dbe70a2.jpg already downloaded
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcb%252F70cb13e5e4265e51bbfe6f2a96395c52%252Fpa%252FYU05925_e563772ff899c550af725469978dbe37.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_e563772ff899c550af725469978dbe37.jpg already downloaded
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fcb%252F70cb13e5e4265e51bbfe6f2a96395c52%252Fpa%252FYU05925_f0d655f35e40309ece0d389de74355e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_f0d655f35e40309ece0d389de74355e9.jpg already downloaded
2026-03-30 09:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cc6d9507-2023-5d5a-993a-6ad61a39875a, identifier: YU05925
2026-03-30 09:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ef53765-4800-5f02-95ea-a373668217f4 with identifier: CZ74992
2026-03-30 09:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ef53765-4800-5f02-95ea-a373668217f4 with identifier: CZ74992
2026-03-30 09:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ef53765-4800-5f02-95ea-a373668217f4 with identifier: CZ74992 to the API
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:47:58Z',
 'fuel_type': 'petrol',
 'id': '8ef53765-4800-5f02-95ea-a373668217f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ74992',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 141435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2016}
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ74992%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [auto1.it] INFO: Saving data for CZ74992: {'auction_closing_time': 1774972078.0, 'created_time': 1773232947.016781, 'last_price_update_time': 1774861683.527444}
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ74992') HTTP/1.1" 204 0
2026-03-30 09:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cc6d9507-2023-5d5a-993a-6ad61a39875a with identifier: YU05925
2026-03-30 09:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cc6d9507-2023-5d5a-993a-6ad61a39875a with identifier: YU05925
2026-03-30 09:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cc6d9507-2023-5d5a-993a-6ad61a39875a with identifier: YU05925 to the API
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU05925>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:22:30Z',
 'fuel_type': 'diesel',
 'id': 'cc6d9507-2023-5d5a-993a-6ad61a39875a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU05925',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 178249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_cb21b9d156b74298b6f0e71d3267f6a4.jpg',
                'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_502b54ee43c9f40430ace774767ce600.jpg',
                'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_43dd090d535e7fe65ae21be3d8aff96b.jpg',
                'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_39021524546851fc8fac83aff0aa2b4f.jpg',
                'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_3d5421e12907d187f85444b9a95707e5.jpg',
                'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_86856b03902597ea8a4caf4b1141fdfa.jpg',
                'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_573d58733286859d891f6a585f70f5d6.jpg',
                'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_e22a500f81e7a020cf7b129e3dbe70a2.jpg',
                'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_e563772ff899c550af725469978dbe37.jpg',
                'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_f0d655f35e40309ece0d389de74355e9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6d9507-2023-5d5a-993a-6ad61a39875a/cc6d9507-2023-5d5a-993a-6ad61a39875a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_cb21b9d156b74298b6f0e71d3267f6a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6d9507-2023-5d5a-993a-6ad61a39875a/cc6d9507-2023-5d5a-993a-6ad61a39875a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_502b54ee43c9f40430ace774767ce600.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6d9507-2023-5d5a-993a-6ad61a39875a/cc6d9507-2023-5d5a-993a-6ad61a39875a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_43dd090d535e7fe65ae21be3d8aff96b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6d9507-2023-5d5a-993a-6ad61a39875a/cc6d9507-2023-5d5a-993a-6ad61a39875a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_39021524546851fc8fac83aff0aa2b4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6d9507-2023-5d5a-993a-6ad61a39875a/cc6d9507-2023-5d5a-993a-6ad61a39875a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_3d5421e12907d187f85444b9a95707e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6d9507-2023-5d5a-993a-6ad61a39875a/cc6d9507-2023-5d5a-993a-6ad61a39875a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_86856b03902597ea8a4caf4b1141fdfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6d9507-2023-5d5a-993a-6ad61a39875a/cc6d9507-2023-5d5a-993a-6ad61a39875a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_573d58733286859d891f6a585f70f5d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6d9507-2023-5d5a-993a-6ad61a39875a/cc6d9507-2023-5d5a-993a-6ad61a39875a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2704062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_e22a500f81e7a020cf7b129e3dbe70a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6d9507-2023-5d5a-993a-6ad61a39875a/cc6d9507-2023-5d5a-993a-6ad61a39875a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2327120,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_e563772ff899c550af725469978dbe37.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6d9507-2023-5d5a-993a-6ad61a39875a/cc6d9507-2023-5d5a-993a-6ad61a39875a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522067,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/cb/70cb13e5e4265e51bbfe6f2a96395c52/pa/YU05925_f0d655f35e40309ece0d389de74355e9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2016}
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU05925%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [auto1.it] INFO: Saving data for YU05925: {'created_time': 1774861683.872656, 'last_price_update_time': 1774861683.872666, 'auction_closing_time': 1774970550.0}
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YU05925') HTTP/1.1" 204 0
2026-03-30 09:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d97952e-68a3-5d94-b7f3-d391180241ee with identifier: TF93411
2026-03-30 09:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d97952e-68a3-5d94-b7f3-d391180241ee with scrape type 1
2026-03-30 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d97952e-68a3-5d94-b7f3-d391180241ee
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F97%252F6e97dd8da4b663a9f30462ff45b4611d%252Fpa%252FTF93411_eb2855333879657ed806e5a14c646fdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_eb2855333879657ed806e5a14c646fdc.jpg already downloaded
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F97%252F6e97dd8da4b663a9f30462ff45b4611d%252Fpa%252FTF93411_9f5f2327d1ca8fe9232b6d0f7176e6d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_9f5f2327d1ca8fe9232b6d0f7176e6d1.jpg already downloaded
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F97%252F6e97dd8da4b663a9f30462ff45b4611d%252Fpa%252FTF93411_c158f241c85c6a54ffe3fabe2c35f9bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_c158f241c85c6a54ffe3fabe2c35f9bc.jpg already downloaded
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F97%252F6e97dd8da4b663a9f30462ff45b4611d%252Fpa%252FTF93411_2ddf2a13d9a2f456cd0d3735941cdc1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_2ddf2a13d9a2f456cd0d3735941cdc1e.jpg already downloaded
2026-03-30 09:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F97%252F6e97dd8da4b663a9f30462ff45b4611d%252Fpa%252FTF93411_db980565f375251a3495044318022331.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_db980565f375251a3495044318022331.jpg already downloaded
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F97%252F6e97dd8da4b663a9f30462ff45b4611d%252Fpa%252FTF93411_12f5b217859579eea44b8b249f6281d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_12f5b217859579eea44b8b249f6281d9.jpg already downloaded
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F97%252F6e97dd8da4b663a9f30462ff45b4611d%252Fpa%252FTF93411_a1db2418740ffd3c1471b368dc6ff61b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_a1db2418740ffd3c1471b368dc6ff61b.jpg already downloaded
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F97%252F6e97dd8da4b663a9f30462ff45b4611d%252Fpa%252FTF93411_31603501b30f1a2002c4f7e02d4bbedb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_31603501b30f1a2002c4f7e02d4bbedb.jpg already downloaded
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F97%252F6e97dd8da4b663a9f30462ff45b4611d%252Fpa%252FTF93411_6d35a9bb731fa4738510dc54ac936c32.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_6d35a9bb731fa4738510dc54ac936c32.jpg already downloaded
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F97%252F6e97dd8da4b663a9f30462ff45b4611d%252Fpa%252FTF93411_26957e9fad83f2c2795b48196c2c883a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_26957e9fad83f2c2795b48196c2c883a.jpg already downloaded
2026-03-30 09:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7d97952e-68a3-5d94-b7f3-d391180241ee, identifier: TF93411
2026-03-30 09:08:04 [scrapy.extensions.logstats] INFO: Crawled 177 pages (at 27 pages/min), scraped 172 items (at 84 items/min)
2026-03-30 09:08:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 09:08:04 [auto1.it] INFO: Found listing with ID: SP98700
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP98700%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [auto1.it] INFO: Scrape type for SP98700: 2
2026-03-30 09:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 372bffe1-b2a5-59a5-9728-d0e9e94f2e1f with identifier: SP98700
2026-03-30 09:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 372bffe1-b2a5-59a5-9728-d0e9e94f2e1f with scrape type 2
2026-03-30 09:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 372bffe1-b2a5-59a5-9728-d0e9e94f2e1f with scrape type 2
2026-03-30 09:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 372bffe1-b2a5-59a5-9728-d0e9e94f2e1f, identifier: SP98700
2026-03-30 09:08:04 [auto1.it] INFO: Found listing with ID: TE89660
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE89660%27 HTTP/1.1" 200 None
2026-03-30 09:08:04 [auto1.it] INFO: Scrape type for TE89660: 2
2026-03-30 09:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb64b1fd-7755-52c6-be95-a41b605372c1 with identifier: TE89660
2026-03-30 09:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb64b1fd-7755-52c6-be95-a41b605372c1 with scrape type 2
2026-03-30 09:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb64b1fd-7755-52c6-be95-a41b605372c1 with scrape type 2
2026-03-30 09:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb64b1fd-7755-52c6-be95-a41b605372c1, identifier: TE89660
2026-03-30 09:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7d97952e-68a3-5d94-b7f3-d391180241ee with identifier: TF93411
2026-03-30 09:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7d97952e-68a3-5d94-b7f3-d391180241ee with identifier: TF93411
2026-03-30 09:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7d97952e-68a3-5d94-b7f3-d391180241ee with identifier: TF93411 to the API
2026-03-30 09:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TF93411>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:58:05Z',
 'fuel_type': 'petrol',
 'id': '7d97952e-68a3-5d94-b7f3-d391180241ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF93411',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 71457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_eb2855333879657ed806e5a14c646fdc.jpg',
                'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_9f5f2327d1ca8fe9232b6d0f7176e6d1.jpg',
                'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_c158f241c85c6a54ffe3fabe2c35f9bc.jpg',
                'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_2ddf2a13d9a2f456cd0d3735941cdc1e.jpg',
                'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_db980565f375251a3495044318022331.jpg',
                'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_12f5b217859579eea44b8b249f6281d9.jpg',
                'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_a1db2418740ffd3c1471b368dc6ff61b.jpg',
                'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_31603501b30f1a2002c4f7e02d4bbedb.jpg',
                'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_6d35a9bb731fa4738510dc54ac936c32.jpg',
                'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_26957e9fad83f2c2795b48196c2c883a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d97952e-68a3-5d94-b7f3-d391180241ee/7d97952e-68a3-5d94-b7f3-d391180241ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_eb2855333879657ed806e5a14c646fdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d97952e-68a3-5d94-b7f3-d391180241ee/7d97952e-68a3-5d94-b7f3-d391180241ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_9f5f2327d1ca8fe9232b6d0f7176e6d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d97952e-68a3-5d94-b7f3-d391180241ee/7d97952e-68a3-5d94-b7f3-d391180241ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_c158f241c85c6a54ffe3fabe2c35f9bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d97952e-68a3-5d94-b7f3-d391180241ee/7d97952e-68a3-5d94-b7f3-d391180241ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_2ddf2a13d9a2f456cd0d3735941cdc1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d97952e-68a3-5d94-b7f3-d391180241ee/7d97952e-68a3-5d94-b7f3-d391180241ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_db980565f375251a3495044318022331.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d97952e-68a3-5d94-b7f3-d391180241ee/7d97952e-68a3-5d94-b7f3-d391180241ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_12f5b217859579eea44b8b249f6281d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d97952e-68a3-5d94-b7f3-d391180241ee/7d97952e-68a3-5d94-b7f3-d391180241ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_a1db2418740ffd3c1471b368dc6ff61b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d97952e-68a3-5d94-b7f3-d391180241ee/7d97952e-68a3-5d94-b7f3-d391180241ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_31603501b30f1a2002c4f7e02d4bbedb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d97952e-68a3-5d94-b7f3-d391180241ee/7d97952e-68a3-5d94-b7f3-d391180241ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_6d35a9bb731fa4738510dc54ac936c32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d97952e-68a3-5d94-b7f3-d391180241ee/7d97952e-68a3-5d94-b7f3-d391180241ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/97/6e97dd8da4b663a9f30462ff45b4611d/pa/TF93411_26957e9fad83f2c2795b48196c2c883a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2012}
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF93411%27 HTTP/1.1" 200 None
2026-03-30 09:08:05 [auto1.it] INFO: Saving data for TF93411: {'created_time': 1774861685.778616, 'last_price_update_time': 1774861685.778628, 'auction_closing_time': 1774972685.0}
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TF93411') HTTP/1.1" 204 0
2026-03-30 09:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 372bffe1-b2a5-59a5-9728-d0e9e94f2e1f with identifier: SP98700
2026-03-30 09:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 372bffe1-b2a5-59a5-9728-d0e9e94f2e1f with identifier: SP98700
2026-03-30 09:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 372bffe1-b2a5-59a5-9728-d0e9e94f2e1f with identifier: SP98700 to the API
2026-03-30 09:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:43:18Z',
 'fuel_type': 'diesel',
 'id': '372bffe1-b2a5-59a5-9728-d0e9e94f2e1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP98700',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 149633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP98700%27 HTTP/1.1" 200 None
2026-03-30 09:08:06 [auto1.it] INFO: Saving data for SP98700: {'auction_closing_time': 1774971798.0, 'created_time': 1774440323.429928, 'last_price_update_time': 1774861686.141733}
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SP98700') HTTP/1.1" 204 0
2026-03-30 09:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb64b1fd-7755-52c6-be95-a41b605372c1 with identifier: TE89660
2026-03-30 09:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb64b1fd-7755-52c6-be95-a41b605372c1 with identifier: TE89660
2026-03-30 09:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb64b1fd-7755-52c6-be95-a41b605372c1 with identifier: TE89660 to the API
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:18:29Z',
 'fuel_type': 'diesel',
 'id': 'eb64b1fd-7755-52c6-be95-a41b605372c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE89660',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 217781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2015}
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE89660%27 HTTP/1.1" 200 None
2026-03-30 09:08:06 [auto1.it] INFO: Saving data for TE89660: {'auction_closing_time': 1774970309.0, 'created_time': 1774386323.824649, 'last_price_update_time': 1774861686.494578}
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TE89660') HTTP/1.1" 204 0
2026-03-30 09:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: LW85334
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW85334%27 HTTP/1.1" 200 None
2026-03-30 09:08:06 [auto1.it] INFO: Scrape type for LW85334: 2
2026-03-30 09:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95158bac-fca8-5733-aa21-811f4ef2ec25 with identifier: LW85334
2026-03-30 09:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95158bac-fca8-5733-aa21-811f4ef2ec25 with scrape type 2
2026-03-30 09:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95158bac-fca8-5733-aa21-811f4ef2ec25 with scrape type 2
2026-03-30 09:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95158bac-fca8-5733-aa21-811f4ef2ec25, identifier: LW85334
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: UB72934
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: RB69324
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: PN79982
2026-03-30 09:08:06 [auto1.it] INFO: Found listing with ID: YT69462
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT69462%27 HTTP/1.1" 200 None
2026-03-30 09:08:06 [auto1.it] INFO: Scrape type for YT69462: 2
2026-03-30 09:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b385197-0d88-53e9-b138-39905c8928f9 with identifier: YT69462
2026-03-30 09:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b385197-0d88-53e9-b138-39905c8928f9 with scrape type 2
2026-03-30 09:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b385197-0d88-53e9-b138-39905c8928f9 with scrape type 2
2026-03-30 09:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4b385197-0d88-53e9-b138-39905c8928f9, identifier: YT69462
2026-03-30 09:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95158bac-fca8-5733-aa21-811f4ef2ec25 with identifier: LW85334
2026-03-30 09:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95158bac-fca8-5733-aa21-811f4ef2ec25 with identifier: LW85334
2026-03-30 09:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 95158bac-fca8-5733-aa21-811f4ef2ec25 with identifier: LW85334 to the API
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:26:33Z',
 'fuel_type': 'diesel',
 'id': '95158bac-fca8-5733-aa21-811f4ef2ec25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW85334',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 143603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-13',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW85334%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Saving data for LW85334: {'auction_closing_time': 1774970793.0, 'created_time': 1773522337.532499, 'last_price_update_time': 1774861687.116585}
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LW85334') HTTP/1.1" 204 0
2026-03-30 09:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4b385197-0d88-53e9-b138-39905c8928f9 with identifier: YT69462
2026-03-30 09:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4b385197-0d88-53e9-b138-39905c8928f9 with identifier: YT69462
2026-03-30 09:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4b385197-0d88-53e9-b138-39905c8928f9 with identifier: YT69462 to the API
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:44:27Z',
 'fuel_type': 'diesel',
 'id': '4b385197-0d88-53e9-b138-39905c8928f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT69462',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 332880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-20',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT69462%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Saving data for YT69462: {'auction_closing_time': 1774971867.0, 'created_time': 1774447548.155131, 'last_price_update_time': 1774861687.602371}
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YT69462') HTTP/1.1" 204 0
2026-03-30 09:08:07 [auto1.it] INFO: Found listing with ID: WE89582
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE89582%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Scrape type for WE89582: 2
2026-03-30 09:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f658772-50eb-5856-b432-765725d7811b with identifier: WE89582
2026-03-30 09:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f658772-50eb-5856-b432-765725d7811b with scrape type 2
2026-03-30 09:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f658772-50eb-5856-b432-765725d7811b with scrape type 2
2026-03-30 09:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f658772-50eb-5856-b432-765725d7811b, identifier: WE89582
2026-03-30 09:08:07 [auto1.it] INFO: Found listing with ID: ZZ84450
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ84450%27 HTTP/1.1" 200 None
2026-03-30 09:08:07 [auto1.it] INFO: Scrape type for ZZ84450: 2
2026-03-30 09:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be31a0ed-accc-574c-846b-d60527012f32 with identifier: ZZ84450
2026-03-30 09:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be31a0ed-accc-574c-846b-d60527012f32 with scrape type 2
2026-03-30 09:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be31a0ed-accc-574c-846b-d60527012f32 with scrape type 2
2026-03-30 09:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be31a0ed-accc-574c-846b-d60527012f32, identifier: ZZ84450
2026-03-30 09:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f658772-50eb-5856-b432-765725d7811b with identifier: WE89582
2026-03-30 09:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f658772-50eb-5856-b432-765725d7811b with identifier: WE89582
2026-03-30 09:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f658772-50eb-5856-b432-765725d7811b with identifier: WE89582 to the API
2026-03-30 09:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-31T15:29:47Z',
 'fuel_type': 'diesel',
 'id': '0f658772-50eb-5856-b432-765725d7811b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE89582',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 242437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-19',
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Diesel Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE89582%27 HTTP/1.1" 200 None
2026-03-30 09:08:08 [auto1.it] INFO: Saving data for WE89582: {'auction_closing_time': 1774970987.0, 'created_time': 1774440344.629126, 'last_price_update_time': 1774861688.189823}
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WE89582') HTTP/1.1" 204 0
2026-03-30 09:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be31a0ed-accc-574c-846b-d60527012f32 with identifier: ZZ84450
2026-03-30 09:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be31a0ed-accc-574c-846b-d60527012f32 with identifier: ZZ84450
2026-03-30 09:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be31a0ed-accc-574c-846b-d60527012f32 with identifier: ZZ84450 to the API
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:45:23Z',
 'fuel_type': 'petrol',
 'id': 'be31a0ed-accc-574c-846b-d60527012f32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ84450',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 98429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ84450%27 HTTP/1.1" 200 None
2026-03-30 09:08:08 [auto1.it] INFO: Saving data for ZZ84450: {'auction_closing_time': 1774971923.0, 'created_time': 1773935623.054366, 'last_price_update_time': 1774861688.527919}
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ84450') HTTP/1.1" 204 0
2026-03-30 09:08:08 [auto1.it] INFO: Found listing with ID: EA17133
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA17133%27 HTTP/1.1" 200 None
2026-03-30 09:08:08 [auto1.it] INFO: Scrape type for EA17133: 2
2026-03-30 09:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with identifier: EA17133
2026-03-30 09:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with scrape type 2
2026-03-30 09:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with scrape type 2
2026-03-30 09:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e, identifier: EA17133
2026-03-30 09:08:08 [auto1.it] INFO: Found listing with ID: JA78037
2026-03-30 09:08:08 [auto1.it] INFO: Found listing with ID: PY49742
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY49742%27 HTTP/1.1" 200 None
2026-03-30 09:08:08 [auto1.it] INFO: Scrape type for PY49742: 2
2026-03-30 09:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d2d594-b4e5-54ce-8b11-6307289c537a with identifier: PY49742
2026-03-30 09:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d2d594-b4e5-54ce-8b11-6307289c537a with scrape type 2
2026-03-30 09:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18d2d594-b4e5-54ce-8b11-6307289c537a with scrape type 2
2026-03-30 09:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18d2d594-b4e5-54ce-8b11-6307289c537a, identifier: PY49742
2026-03-30 09:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with identifier: EA17133
2026-03-30 09:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with identifier: EA17133
2026-03-30 09:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e with identifier: EA17133 to the API
2026-03-30 09:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:12:54Z',
 'fuel_type': 'diesel',
 'id': '12bf7e9c-62c2-5ec4-883d-79e1c61cdf0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA17133',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 328862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-28',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA17133%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Saving data for EA17133: {'auction_closing_time': 1774969974.0, 'created_time': 1773237345.862387, 'last_price_update_time': 1774861689.201749}
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA17133') HTTP/1.1" 204 0
2026-03-30 09:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18d2d594-b4e5-54ce-8b11-6307289c537a with identifier: PY49742
2026-03-30 09:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18d2d594-b4e5-54ce-8b11-6307289c537a with identifier: PY49742
2026-03-30 09:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18d2d594-b4e5-54ce-8b11-6307289c537a with identifier: PY49742 to the API
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:43:00Z',
 'fuel_type': 'diesel',
 'id': '18d2d594-b4e5-54ce-8b11-6307289c537a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY49742',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 270274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY49742%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Saving data for PY49742: {'auction_closing_time': 1774971780.0, 'created_time': 1774473038.021368, 'last_price_update_time': 1774861689.565033}
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PY49742') HTTP/1.1" 204 0
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: LP18023
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP18023%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Scrape type for LP18023: 2
2026-03-30 09:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 205e7968-ac14-575e-8778-2f3f606ba3fa with identifier: LP18023
2026-03-30 09:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 205e7968-ac14-575e-8778-2f3f606ba3fa with scrape type 2
2026-03-30 09:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 205e7968-ac14-575e-8778-2f3f606ba3fa with scrape type 2
2026-03-30 09:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 205e7968-ac14-575e-8778-2f3f606ba3fa, identifier: LP18023
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: JH99386
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: AS63224
2026-03-30 09:08:09 [auto1.it] INFO: Found listing with ID: AA10664
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA10664%27 HTTP/1.1" 200 None
2026-03-30 09:08:09 [auto1.it] INFO: Scrape type for AA10664: 2
2026-03-30 09:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1496c692-b55b-5942-b387-a85f468522a5 with identifier: AA10664
2026-03-30 09:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1496c692-b55b-5942-b387-a85f468522a5 with scrape type 2
2026-03-30 09:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1496c692-b55b-5942-b387-a85f468522a5 with scrape type 2
2026-03-30 09:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1496c692-b55b-5942-b387-a85f468522a5, identifier: AA10664
2026-03-30 09:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 205e7968-ac14-575e-8778-2f3f606ba3fa with identifier: LP18023
2026-03-30 09:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 205e7968-ac14-575e-8778-2f3f606ba3fa with identifier: LP18023
2026-03-30 09:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 205e7968-ac14-575e-8778-2f3f606ba3fa with identifier: LP18023 to the API
2026-03-30 09:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:51:04Z',
 'fuel_type': 'diesel',
 'id': '205e7968-ac14-575e-8778-2f3f606ba3fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP18023',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 267101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2016}
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP18023%27 HTTP/1.1" 200 None
2026-03-30 09:08:11 [auto1.it] INFO: Saving data for LP18023: {'auction_closing_time': 1774972264.0, 'created_time': 1773522407.543696, 'last_price_update_time': 1774861691.121548}
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LP18023') HTTP/1.1" 204 0
2026-03-30 09:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1496c692-b55b-5942-b387-a85f468522a5 with identifier: AA10664
2026-03-30 09:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1496c692-b55b-5942-b387-a85f468522a5 with identifier: AA10664
2026-03-30 09:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1496c692-b55b-5942-b387-a85f468522a5 with identifier: AA10664 to the API
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:22Z',
 'fuel_type': 'diesel',
 'id': '1496c692-b55b-5942-b387-a85f468522a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA10664',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 150258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-22',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2019}
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA10664%27 HTTP/1.1" 200 None
2026-03-30 09:08:11 [auto1.it] INFO: Saving data for AA10664: {'auction_closing_time': 1774971742.0, 'created_time': 1773824719.861862, 'last_price_update_time': 1774861691.500326}
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AA10664') HTTP/1.1" 204 0
2026-03-30 09:08:11 [auto1.it] INFO: Found listing with ID: MZ33664
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ33664%27 HTTP/1.1" 200 None
2026-03-30 09:08:11 [auto1.it] INFO: Scrape type for MZ33664: 2
2026-03-30 09:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1519246f-ede4-55a7-b318-781726a0ba03 with identifier: MZ33664
2026-03-30 09:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1519246f-ede4-55a7-b318-781726a0ba03 with scrape type 2
2026-03-30 09:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1519246f-ede4-55a7-b318-781726a0ba03 with scrape type 2
2026-03-30 09:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1519246f-ede4-55a7-b318-781726a0ba03, identifier: MZ33664
2026-03-30 09:08:11 [auto1.it] INFO: Found listing with ID: AM15207
2026-03-30 09:08:11 [auto1.it] INFO: Found listing with ID: WS56661
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS56661%27 HTTP/1.1" 200 None
2026-03-30 09:08:11 [auto1.it] INFO: Scrape type for WS56661: 2
2026-03-30 09:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ce2114-0714-5ba3-b437-8b4ac1743ca5 with identifier: WS56661
2026-03-30 09:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ce2114-0714-5ba3-b437-8b4ac1743ca5 with scrape type 2
2026-03-30 09:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25ce2114-0714-5ba3-b437-8b4ac1743ca5 with scrape type 2
2026-03-30 09:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25ce2114-0714-5ba3-b437-8b4ac1743ca5, identifier: WS56661
2026-03-30 09:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1519246f-ede4-55a7-b318-781726a0ba03 with identifier: MZ33664
2026-03-30 09:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1519246f-ede4-55a7-b318-781726a0ba03 with identifier: MZ33664
2026-03-30 09:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1519246f-ede4-55a7-b318-781726a0ba03 with identifier: MZ33664 to the API
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:02:17Z',
 'fuel_type': 'diesel',
 'id': '1519246f-ede4-55a7-b318-781726a0ba03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ33664',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 163185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-23',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ33664%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Saving data for MZ33664: {'auction_closing_time': 1774969337.0, 'created_time': 1774041081.337769, 'last_price_update_time': 1774861692.053231}
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MZ33664') HTTP/1.1" 204 0
2026-03-30 09:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25ce2114-0714-5ba3-b437-8b4ac1743ca5 with identifier: WS56661
2026-03-30 09:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25ce2114-0714-5ba3-b437-8b4ac1743ca5 with identifier: WS56661
2026-03-30 09:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 25ce2114-0714-5ba3-b437-8b4ac1743ca5 with identifier: WS56661 to the API
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:19:25Z',
 'fuel_type': 'diesel',
 'id': '25ce2114-0714-5ba3-b437-8b4ac1743ca5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS56661',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 167415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-23',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Admired',
 'transmission': 'manual',
 'trim': 'Admired',
 'year': 2013}
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS56661%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Saving data for WS56661: {'auction_closing_time': 1774970365.0, 'created_time': 1773954512.282921, 'last_price_update_time': 1774861692.51025}
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WS56661') HTTP/1.1" 204 0
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: NL70600
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL70600%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Scrape type for NL70600: 2
2026-03-30 09:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be58d42e-9ab3-55c5-abbe-34378a8e6f58 with identifier: NL70600
2026-03-30 09:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be58d42e-9ab3-55c5-abbe-34378a8e6f58 with scrape type 2
2026-03-30 09:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be58d42e-9ab3-55c5-abbe-34378a8e6f58 with scrape type 2
2026-03-30 09:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be58d42e-9ab3-55c5-abbe-34378a8e6f58, identifier: NL70600
2026-03-30 09:08:12 [auto1.it] INFO: Found listing with ID: EU06548
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU06548%27 HTTP/1.1" 200 None
2026-03-30 09:08:12 [auto1.it] INFO: Scrape type for EU06548: 2
2026-03-30 09:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60b79b9f-3dbe-5fcb-8e73-ac9f2f94f292 with identifier: EU06548
2026-03-30 09:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60b79b9f-3dbe-5fcb-8e73-ac9f2f94f292 with scrape type 2
2026-03-30 09:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60b79b9f-3dbe-5fcb-8e73-ac9f2f94f292 with scrape type 2
2026-03-30 09:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 60b79b9f-3dbe-5fcb-8e73-ac9f2f94f292, identifier: EU06548
2026-03-30 09:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be58d42e-9ab3-55c5-abbe-34378a8e6f58 with identifier: NL70600
2026-03-30 09:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be58d42e-9ab3-55c5-abbe-34378a8e6f58 with identifier: NL70600
2026-03-30 09:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be58d42e-9ab3-55c5-abbe-34378a8e6f58 with identifier: NL70600 to the API
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:25:41Z',
 'fuel_type': 'diesel',
 'id': 'be58d42e-9ab3-55c5-abbe-34378a8e6f58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL70600',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 127144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2017}
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL70600%27 HTTP/1.1" 200 None
2026-03-30 09:08:13 [auto1.it] INFO: Saving data for NL70600: {'auction_closing_time': 1774970741.0, 'created_time': 1773328274.281032, 'last_price_update_time': 1774861693.091999}
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NL70600') HTTP/1.1" 204 0
2026-03-30 09:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 60b79b9f-3dbe-5fcb-8e73-ac9f2f94f292 with identifier: EU06548
2026-03-30 09:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 60b79b9f-3dbe-5fcb-8e73-ac9f2f94f292 with identifier: EU06548
2026-03-30 09:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 60b79b9f-3dbe-5fcb-8e73-ac9f2f94f292 with identifier: EU06548 to the API
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:26:53Z',
 'fuel_type': 'petrol',
 'id': '60b79b9f-3dbe-5fcb-8e73-ac9f2f94f292',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU06548',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 219824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-09',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2017}
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU06548%27 HTTP/1.1" 200 None
2026-03-30 09:08:13 [auto1.it] INFO: Saving data for EU06548: {'auction_closing_time': 1774970813.0, 'created_time': 1773954464.526309, 'last_price_update_time': 1774861693.443555}
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU06548') HTTP/1.1" 204 0
2026-03-30 09:08:13 [auto1.it] INFO: Found listing with ID: YV46524
2026-03-30 09:08:13 [auto1.it] INFO: Found listing with ID: TN90495
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN90495%27 HTTP/1.1" 200 None
2026-03-30 09:08:13 [auto1.it] INFO: Scrape type for TN90495: 2
2026-03-30 09:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bd95b05-bc94-558c-b147-4e9958270cd0 with identifier: TN90495
2026-03-30 09:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd95b05-bc94-558c-b147-4e9958270cd0 with scrape type 2
2026-03-30 09:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bd95b05-bc94-558c-b147-4e9958270cd0 with scrape type 2
2026-03-30 09:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6bd95b05-bc94-558c-b147-4e9958270cd0, identifier: TN90495
2026-03-30 09:08:13 [auto1.it] INFO: Found listing with ID: NR20429
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR20429%27 HTTP/1.1" 200 None
2026-03-30 09:08:13 [auto1.it] INFO: Scrape type for NR20429: 2
2026-03-30 09:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b290e0e-3abc-585b-897b-2cb8a74be10f with identifier: NR20429
2026-03-30 09:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b290e0e-3abc-585b-897b-2cb8a74be10f with scrape type 2
2026-03-30 09:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b290e0e-3abc-585b-897b-2cb8a74be10f with scrape type 2
2026-03-30 09:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0b290e0e-3abc-585b-897b-2cb8a74be10f, identifier: NR20429
2026-03-30 09:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS01287> (referer: https://www.auto1.com/v1/car-details-view/HS01287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6bd95b05-bc94-558c-b147-4e9958270cd0 with identifier: TN90495
2026-03-30 09:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6bd95b05-bc94-558c-b147-4e9958270cd0 with identifier: TN90495
2026-03-30 09:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6bd95b05-bc94-558c-b147-4e9958270cd0 with identifier: TN90495 to the API
2026-03-30 09:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:13:04Z',
 'fuel_type': 'petrol',
 'id': '6bd95b05-bc94-558c-b147-4e9958270cd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN90495',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 60109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN90495%27 HTTP/1.1" 200 None
2026-03-30 09:08:14 [auto1.it] INFO: Saving data for TN90495: {'auction_closing_time': 1774969984.0, 'created_time': 1774447589.540217, 'last_price_update_time': 1774861694.184617}
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TN90495') HTTP/1.1" 204 0
2026-03-30 09:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0b290e0e-3abc-585b-897b-2cb8a74be10f with identifier: NR20429
2026-03-30 09:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0b290e0e-3abc-585b-897b-2cb8a74be10f with identifier: NR20429
2026-03-30 09:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0b290e0e-3abc-585b-897b-2cb8a74be10f with identifier: NR20429 to the API
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:10:59Z',
 'fuel_type': 'petrol',
 'id': '0b290e0e-3abc-585b-897b-2cb8a74be10f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR20429',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 64207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-05',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2019}
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR20429%27 HTTP/1.1" 200 None
2026-03-30 09:08:14 [auto1.it] INFO: Saving data for NR20429: {'auction_closing_time': 1774969859.0, 'created_time': 1774015974.819309, 'last_price_update_time': 1774861694.571902}
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR20429') HTTP/1.1" 204 0
2026-03-30 09:08:14 [auto1.it] INFO: Found listing with ID: AU20184
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU20184%27 HTTP/1.1" 200 None
2026-03-30 09:08:14 [auto1.it] INFO: Scrape type for AU20184: 2
2026-03-30 09:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60e25ea0-abfc-5995-84c9-fc5214edf0be with identifier: AU20184
2026-03-30 09:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60e25ea0-abfc-5995-84c9-fc5214edf0be with scrape type 2
2026-03-30 09:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60e25ea0-abfc-5995-84c9-fc5214edf0be with scrape type 2
2026-03-30 09:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 60e25ea0-abfc-5995-84c9-fc5214edf0be, identifier: AU20184
2026-03-30 09:08:14 [auto1.it] INFO: Found listing with ID: YJ46375
2026-03-30 09:08:14 [auto1.it] INFO: Found listing with ID: MR49146
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR49146%27 HTTP/1.1" 200 None
2026-03-30 09:08:14 [auto1.it] INFO: Scrape type for MR49146: 2
2026-03-30 09:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd5e3c5e-affe-5f3f-8eb1-b72d1531e262 with identifier: MR49146
2026-03-30 09:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd5e3c5e-affe-5f3f-8eb1-b72d1531e262 with scrape type 2
2026-03-30 09:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd5e3c5e-affe-5f3f-8eb1-b72d1531e262 with scrape type 2
2026-03-30 09:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd5e3c5e-affe-5f3f-8eb1-b72d1531e262, identifier: MR49146
2026-03-30 09:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN01544> (referer: https://www.auto1.com/v1/car-details-view/GN01544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 60e25ea0-abfc-5995-84c9-fc5214edf0be with identifier: AU20184
2026-03-30 09:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 60e25ea0-abfc-5995-84c9-fc5214edf0be with identifier: AU20184
2026-03-30 09:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 60e25ea0-abfc-5995-84c9-fc5214edf0be with identifier: AU20184 to the API
2026-03-30 09:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:57:39Z',
 'fuel_type': 'petrol',
 'id': '60e25ea0-abfc-5995-84c9-fc5214edf0be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU20184',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 174601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2019}
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU20184%27 HTTP/1.1" 200 None
2026-03-30 09:08:15 [auto1.it] INFO: Saving data for AU20184: {'auction_closing_time': 1774972659.0, 'created_time': 1774353945.005567, 'last_price_update_time': 1774861695.276306}
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AU20184') HTTP/1.1" 204 0
2026-03-30 09:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd5e3c5e-affe-5f3f-8eb1-b72d1531e262 with identifier: MR49146
2026-03-30 09:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd5e3c5e-affe-5f3f-8eb1-b72d1531e262 with identifier: MR49146
2026-03-30 09:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd5e3c5e-affe-5f3f-8eb1-b72d1531e262 with identifier: MR49146 to the API
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:22:44Z',
 'fuel_type': 'diesel',
 'id': 'bd5e3c5e-affe-5f3f-8eb1-b72d1531e262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR49146',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 188259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-03',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR49146%27 HTTP/1.1" 200 None
2026-03-30 09:08:15 [auto1.it] INFO: Saving data for MR49146: {'auction_closing_time': 1774970564.0, 'created_time': 1773500827.669248, 'last_price_update_time': 1774861695.678569}
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR49146') HTTP/1.1" 204 0
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: SK44334
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: JH80469
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH80469%27 HTTP/1.1" 200 None
2026-03-30 09:08:15 [auto1.it] INFO: Scrape type for JH80469: 1
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: FY24285
2026-03-30 09:08:15 [auto1.it] INFO: Found listing with ID: AK03087
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK03087%27 HTTP/1.1" 200 None
2026-03-30 09:08:15 [auto1.it] INFO: Scrape type for AK03087: 2
2026-03-30 09:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0f8a04d-3862-5ce0-96f8-635625ec6321 with identifier: AK03087
2026-03-30 09:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0f8a04d-3862-5ce0-96f8-635625ec6321 with scrape type 2
2026-03-30 09:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0f8a04d-3862-5ce0-96f8-635625ec6321 with scrape type 2
2026-03-30 09:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b0f8a04d-3862-5ce0-96f8-635625ec6321, identifier: AK03087
2026-03-30 09:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR96583/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b0f8a04d-3862-5ce0-96f8-635625ec6321 with identifier: AK03087
2026-03-30 09:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b0f8a04d-3862-5ce0-96f8-635625ec6321 with identifier: AK03087
2026-03-30 09:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b0f8a04d-3862-5ce0-96f8-635625ec6321 with identifier: AK03087 to the API
2026-03-30 09:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:03:56Z',
 'fuel_type': 'diesel',
 'id': 'b0f8a04d-3862-5ce0-96f8-635625ec6321',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK03087',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 269177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-22',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi XPossible 2WD',
 'transmission': 'manual',
 'trim': 'XPossible 2WD',
 'year': 2013}
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK03087%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [auto1.it] INFO: Saving data for AK03087: {'auction_closing_time': 1774969436.0, 'created_time': 1772695260.716711, 'last_price_update_time': 1774861696.161648}
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK03087') HTTP/1.1" 204 0
2026-03-30 09:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e509d4-5749-5c47-997d-0683d317f55a with identifier: HS01287
2026-03-30 09:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e509d4-5749-5c47-997d-0683d317f55a with scrape type 1
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33e509d4-5749-5c47-997d-0683d317f55a
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F4f%252F5a4f827dfc5848f370b30233960da394%252Fpa%252FHS01287_a711d1e6d3d8105733d55a54a68090bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_a711d1e6d3d8105733d55a54a68090bf.jpg already downloaded
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F4f%252F5a4f827dfc5848f370b30233960da394%252Fpa%252FHS01287_74d3d6b5f39919096e4d6e2a8b17f90a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_74d3d6b5f39919096e4d6e2a8b17f90a.jpg already downloaded
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F4f%252F5a4f827dfc5848f370b30233960da394%252Fpa%252FHS01287_e1f53abdf10d2c0694a99db037e20c75.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_e1f53abdf10d2c0694a99db037e20c75.jpg already downloaded
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F4f%252F5a4f827dfc5848f370b30233960da394%252Fpa%252FHS01287_3000bd12375635084bcf990f2b221c09.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_3000bd12375635084bcf990f2b221c09.jpg already downloaded
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F4f%252F5a4f827dfc5848f370b30233960da394%252Fpa%252FHS01287_c8f1293b90e27dbd21e8b3b9176ba59a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_c8f1293b90e27dbd21e8b3b9176ba59a.jpg already downloaded
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F4f%252F5a4f827dfc5848f370b30233960da394%252Fpa%252FHS01287_6a4f437629952533c4dc3e2cb8a12463.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_6a4f437629952533c4dc3e2cb8a12463.jpg already downloaded
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F4f%252F5a4f827dfc5848f370b30233960da394%252Fpa%252FHS01287_26aa5514ed9e3a1ebc7dd3ba1f5933f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_26aa5514ed9e3a1ebc7dd3ba1f5933f1.jpg already downloaded
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F4f%252F5a4f827dfc5848f370b30233960da394%252Fpa%252FHS01287_3c26119ac663709a7a005de9de284881.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_3c26119ac663709a7a005de9de284881.jpg already downloaded
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F4f%252F5a4f827dfc5848f370b30233960da394%252Fpa%252FHS01287_8f0bfd0c9b3dd0ac6a560318cd7a44ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_8f0bfd0c9b3dd0ac6a560318cd7a44ca.jpg already downloaded
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252F4f%252F5a4f827dfc5848f370b30233960da394%252Fpa%252FHS01287_3788e83abddfca30edd8ae272da83bf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_3788e83abddfca30edd8ae272da83bf0.jpg already downloaded
2026-03-30 09:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33e509d4-5749-5c47-997d-0683d317f55a, identifier: HS01287
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: HZ78345
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ78345%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [auto1.it] INFO: Scrape type for HZ78345: 2
2026-03-30 09:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bed589e4-d6e6-5385-861e-2eab45edda25 with identifier: HZ78345
2026-03-30 09:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bed589e4-d6e6-5385-861e-2eab45edda25 with scrape type 2
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bed589e4-d6e6-5385-861e-2eab45edda25 with scrape type 2
2026-03-30 09:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bed589e4-d6e6-5385-861e-2eab45edda25, identifier: HZ78345
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: SK14741
2026-03-30 09:08:16 [auto1.it] INFO: Found listing with ID: EY99880
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY99880%27 HTTP/1.1" 200 None
2026-03-30 09:08:16 [auto1.it] INFO: Scrape type for EY99880: 2
2026-03-30 09:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b1b7274-8f90-56d8-86e1-463d08c43200 with identifier: EY99880
2026-03-30 09:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b1b7274-8f90-56d8-86e1-463d08c43200 with scrape type 2
2026-03-30 09:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b1b7274-8f90-56d8-86e1-463d08c43200 with scrape type 2
2026-03-30 09:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b1b7274-8f90-56d8-86e1-463d08c43200, identifier: EY99880
2026-03-30 09:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT54121> (referer: https://www.auto1.com/v1/car-details-view/ZT54121/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33e509d4-5749-5c47-997d-0683d317f55a with identifier: HS01287
2026-03-30 09:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33e509d4-5749-5c47-997d-0683d317f55a with identifier: HS01287
2026-03-30 09:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33e509d4-5749-5c47-997d-0683d317f55a with identifier: HS01287 to the API
2026-03-30 09:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HS01287>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:54:25Z',
 'fuel_type': 'petrol',
 'id': '33e509d4-5749-5c47-997d-0683d317f55a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS01287',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Abarth',
 'model': '595C',
 'odometer': 104325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_a711d1e6d3d8105733d55a54a68090bf.jpg',
                'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_74d3d6b5f39919096e4d6e2a8b17f90a.jpg',
                'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_e1f53abdf10d2c0694a99db037e20c75.jpg',
                'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_3000bd12375635084bcf990f2b221c09.jpg',
                'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_c8f1293b90e27dbd21e8b3b9176ba59a.jpg',
                'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_6a4f437629952533c4dc3e2cb8a12463.jpg',
                'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_26aa5514ed9e3a1ebc7dd3ba1f5933f1.jpg',
                'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_3c26119ac663709a7a005de9de284881.jpg',
                'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_8f0bfd0c9b3dd0ac6a560318cd7a44ca.jpg',
                'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_3788e83abddfca30edd8ae272da83bf0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e509d4-5749-5c47-997d-0683d317f55a/33e509d4-5749-5c47-997d-0683d317f55a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_a711d1e6d3d8105733d55a54a68090bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e509d4-5749-5c47-997d-0683d317f55a/33e509d4-5749-5c47-997d-0683d317f55a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_74d3d6b5f39919096e4d6e2a8b17f90a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e509d4-5749-5c47-997d-0683d317f55a/33e509d4-5749-5c47-997d-0683d317f55a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_e1f53abdf10d2c0694a99db037e20c75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e509d4-5749-5c47-997d-0683d317f55a/33e509d4-5749-5c47-997d-0683d317f55a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_3000bd12375635084bcf990f2b221c09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e509d4-5749-5c47-997d-0683d317f55a/33e509d4-5749-5c47-997d-0683d317f55a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_c8f1293b90e27dbd21e8b3b9176ba59a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e509d4-5749-5c47-997d-0683d317f55a/33e509d4-5749-5c47-997d-0683d317f55a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_6a4f437629952533c4dc3e2cb8a12463.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e509d4-5749-5c47-997d-0683d317f55a/33e509d4-5749-5c47-997d-0683d317f55a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_26aa5514ed9e3a1ebc7dd3ba1f5933f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e509d4-5749-5c47-997d-0683d317f55a/33e509d4-5749-5c47-997d-0683d317f55a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_3c26119ac663709a7a005de9de284881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e509d4-5749-5c47-997d-0683d317f55a/33e509d4-5749-5c47-997d-0683d317f55a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_8f0bfd0c9b3dd0ac6a560318cd7a44ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33e509d4-5749-5c47-997d-0683d317f55a/33e509d4-5749-5c47-997d-0683d317f55a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/4f/5a4f827dfc5848f370b30233960da394/pa/HS01287_3788e83abddfca30edd8ae272da83bf0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Abarth 595C 1.4 Turismo',
 'transmission': 'automatic',
 'trim': 'Turismo',
 'year': 2015}
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS01287%27 HTTP/1.1" 200 None
2026-03-30 09:08:17 [auto1.it] INFO: Saving data for HS01287: {'created_time': 1774861697.760478, 'last_price_update_time': 1774861697.76049, 'auction_closing_time': 1774972465.0}
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HS01287') HTTP/1.1" 204 0
2026-03-30 09:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bed589e4-d6e6-5385-861e-2eab45edda25 with identifier: HZ78345
2026-03-30 09:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bed589e4-d6e6-5385-861e-2eab45edda25 with identifier: HZ78345
2026-03-30 09:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bed589e4-d6e6-5385-861e-2eab45edda25 with identifier: HZ78345 to the API
2026-03-30 09:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:36:49Z',
 'fuel_type': 'diesel',
 'id': 'bed589e4-d6e6-5385-861e-2eab45edda25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ78345',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 236623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-08',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ78345%27 HTTP/1.1" 200 None
2026-03-30 09:08:18 [auto1.it] INFO: Saving data for HZ78345: {'auction_closing_time': 1774971409.0, 'created_time': 1774559518.265768, 'last_price_update_time': 1774861698.160964}
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HZ78345') HTTP/1.1" 204 0
2026-03-30 09:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b1b7274-8f90-56d8-86e1-463d08c43200 with identifier: EY99880
2026-03-30 09:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b1b7274-8f90-56d8-86e1-463d08c43200 with identifier: EY99880
2026-03-30 09:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b1b7274-8f90-56d8-86e1-463d08c43200 with identifier: EY99880 to the API
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:28:16Z',
 'fuel_type': 'diesel',
 'id': '6b1b7274-8f90-56d8-86e1-463d08c43200',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY99880',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 122566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 e-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY99880%27 HTTP/1.1" 200 None
2026-03-30 09:08:18 [auto1.it] INFO: Saving data for EY99880: {'auction_closing_time': 1774970896.0, 'created_time': 1773954533.439195, 'last_price_update_time': 1774861698.577135}
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EY99880') HTTP/1.1" 204 0
2026-03-30 09:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7234cc4b-05e8-5a36-98cc-ecae825da1db with identifier: GN01544
2026-03-30 09:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7234cc4b-05e8-5a36-98cc-ecae825da1db with scrape type 1
2026-03-30 09:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7234cc4b-05e8-5a36-98cc-ecae825da1db
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_d4ba56fa55f9dba609ef931ce5534592.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_d4ba56fa55f9dba609ef931ce5534592.jpg not downloaded yet
2026-03-30 09:08:18 [auto1.it] INFO: Found listing with ID: PK52051
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK52051%27 HTTP/1.1" 200 None
2026-03-30 09:08:18 [auto1.it] INFO: Scrape type for PK52051: 2
2026-03-30 09:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d46482bb-0f75-5d9e-b460-64321017a35d with identifier: PK52051
2026-03-30 09:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46482bb-0f75-5d9e-b460-64321017a35d with scrape type 2
2026-03-30 09:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d46482bb-0f75-5d9e-b460-64321017a35d with scrape type 2
2026-03-30 09:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d46482bb-0f75-5d9e-b460-64321017a35d, identifier: PK52051
2026-03-30 09:08:18 [auto1.it] INFO: Found listing with ID: TW09366
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW09366%27 HTTP/1.1" 200 None
2026-03-30 09:08:18 [auto1.it] INFO: Scrape type for TW09366: 2
2026-03-30 09:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af45699a-b0e5-5831-ab6a-c037c5214e1f with identifier: TW09366
2026-03-30 09:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af45699a-b0e5-5831-ab6a-c037c5214e1f with scrape type 2
2026-03-30 09:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af45699a-b0e5-5831-ab6a-c037c5214e1f with scrape type 2
2026-03-30 09:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af45699a-b0e5-5831-ab6a-c037c5214e1f, identifier: TW09366
2026-03-30 09:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d46482bb-0f75-5d9e-b460-64321017a35d with identifier: PK52051
2026-03-30 09:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d46482bb-0f75-5d9e-b460-64321017a35d with identifier: PK52051
2026-03-30 09:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d46482bb-0f75-5d9e-b460-64321017a35d with identifier: PK52051 to the API
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:43:14Z',
 'fuel_type': 'diesel',
 'id': 'd46482bb-0f75-5d9e-b460-64321017a35d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK52051',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 196146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2019}
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK52051%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [auto1.it] INFO: Saving data for PK52051: {'auction_closing_time': 1774971794.0, 'created_time': 1774473137.308306, 'last_price_update_time': 1774861699.26487}
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PK52051') HTTP/1.1" 204 0
2026-03-30 09:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af45699a-b0e5-5831-ab6a-c037c5214e1f with identifier: TW09366
2026-03-30 09:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af45699a-b0e5-5831-ab6a-c037c5214e1f with identifier: TW09366
2026-03-30 09:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af45699a-b0e5-5831-ab6a-c037c5214e1f with identifier: TW09366 to the API
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-31T15:44:07Z',
 'fuel_type': 'diesel',
 'id': 'af45699a-b0e5-5831-ab6a-c037c5214e1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW09366',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 204085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-30',
 'seller_name': None,
 'title': 'Subaru XV 2.0 Diesel Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW09366%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [auto1.it] INFO: Saving data for TW09366: {'auction_closing_time': 1774971847.0, 'created_time': 1773132090.707559, 'last_price_update_time': 1774861699.690568}
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TW09366') HTTP/1.1" 204 0
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_7cf51822bf11aac276d9376c98156b54.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7cf51822bf11aac276d9376c98156b54.jpg not downloaded yet
2026-03-30 09:08:19 [auto1.it] INFO: Channel: 24h | Page: 11 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd with identifier: ZT54121
2026-03-30 09:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd with scrape type 1
2026-03-30 09:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_68de8caabe93439d31009631fa76362a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_68de8caabe93439d31009631fa76362a.jpg not downloaded yet
2026-03-30 09:08:19 [auto1.it] INFO: Found listing with ID: TE89660
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE89660%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [auto1.it] INFO: Scrape type for TE89660: 0
2026-03-30 09:08:19 [auto1.it] INFO: Found listing with ID: UB72934
2026-03-30 09:08:19 [auto1.it] INFO: Found listing with ID: DS55182
2026-03-30 09:08:19 [auto1.it] INFO: Found listing with ID: RG52060
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG52060%27 HTTP/1.1" 200 None
2026-03-30 09:08:19 [auto1.it] INFO: Scrape type for RG52060: 2
2026-03-30 09:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 326723d6-268d-58c4-8028-c9e1da634fb6 with identifier: RG52060
2026-03-30 09:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 326723d6-268d-58c4-8028-c9e1da634fb6 with scrape type 2
2026-03-30 09:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 326723d6-268d-58c4-8028-c9e1da634fb6 with scrape type 2
2026-03-30 09:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 326723d6-268d-58c4-8028-c9e1da634fb6, identifier: RG52060
2026-03-30 09:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 326723d6-268d-58c4-8028-c9e1da634fb6 with identifier: RG52060
2026-03-30 09:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 326723d6-268d-58c4-8028-c9e1da634fb6 with identifier: RG52060
2026-03-30 09:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 326723d6-268d-58c4-8028-c9e1da634fb6 with identifier: RG52060 to the API
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:34:24Z',
 'fuel_type': 'diesel',
 'id': '326723d6-268d-58c4-8028-c9e1da634fb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG52060',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 329499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Line BlueMotion Tech.',
 'transmission': 'automatic',
 'trim': 'Business Line BlueMotion Tech.',
 'year': 2018}
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG52060%27 HTTP/1.1" 200 None
2026-03-30 09:08:20 [auto1.it] INFO: Saving data for RG52060: {'auction_closing_time': 1774971264.0, 'created_time': 1774040893.400174, 'last_price_update_time': 1774861700.861567}
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG52060') HTTP/1.1" 204 0
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_b8550a85a66fa8659a756e606487d0bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_b8550a85a66fa8659a756e606487d0bd.jpg not downloaded yet
2026-03-30 09:08:20 [auto1.it] INFO: Found listing with ID: HY22181
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY22181%27 HTTP/1.1" 200 None
2026-03-30 09:08:20 [auto1.it] INFO: Scrape type for HY22181: 2
2026-03-30 09:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95a19578-fb9e-5a2a-bfb0-a0cdb19d2d2c with identifier: HY22181
2026-03-30 09:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95a19578-fb9e-5a2a-bfb0-a0cdb19d2d2c with scrape type 2
2026-03-30 09:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95a19578-fb9e-5a2a-bfb0-a0cdb19d2d2c with scrape type 2
2026-03-30 09:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95a19578-fb9e-5a2a-bfb0-a0cdb19d2d2c, identifier: HY22181
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_6a1413d6c7cf2fafedee9568d59be39a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_6a1413d6c7cf2fafedee9568d59be39a.jpg not downloaded yet
2026-03-30 09:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:21 [auto1.it] INFO: Found listing with ID: GX31313
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX31313%27 HTTP/1.1" 200 None
2026-03-30 09:08:21 [auto1.it] INFO: Scrape type for GX31313: 2
2026-03-30 09:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b43d2e20-c8df-59af-b4b4-c0d63c80aab6 with identifier: GX31313
2026-03-30 09:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b43d2e20-c8df-59af-b4b4-c0d63c80aab6 with scrape type 2
2026-03-30 09:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b43d2e20-c8df-59af-b4b4-c0d63c80aab6 with scrape type 2
2026-03-30 09:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b43d2e20-c8df-59af-b4b4-c0d63c80aab6, identifier: GX31313
2026-03-30 09:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95a19578-fb9e-5a2a-bfb0-a0cdb19d2d2c with identifier: HY22181
2026-03-30 09:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95a19578-fb9e-5a2a-bfb0-a0cdb19d2d2c with identifier: HY22181
2026-03-30 09:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 95a19578-fb9e-5a2a-bfb0-a0cdb19d2d2c with identifier: HY22181 to the API
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-31T15:36:52Z',
 'fuel_type': 'petrol',
 'id': '95a19578-fb9e-5a2a-bfb0-a0cdb19d2d2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY22181',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 46007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-27',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY22181%27 HTTP/1.1" 200 None
2026-03-30 09:08:21 [auto1.it] INFO: Saving data for HY22181: {'auction_closing_time': 1774971412.0, 'created_time': 1774386405.046914, 'last_price_update_time': 1774861701.540161}
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY22181') HTTP/1.1" 204 0
2026-03-30 09:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_d4ba56fa55f9dba609ef931ce5534592.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b43d2e20-c8df-59af-b4b4-c0d63c80aab6 with identifier: GX31313
2026-03-30 09:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b43d2e20-c8df-59af-b4b4-c0d63c80aab6 with identifier: GX31313
2026-03-30 09:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b43d2e20-c8df-59af-b4b4-c0d63c80aab6 with identifier: GX31313 to the API
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:59:54Z',
 'fuel_type': 'diesel',
 'id': 'b43d2e20-c8df-59af-b4b4-c0d63c80aab6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX31313',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 172328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-29',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2010}
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX31313%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [auto1.it] INFO: Saving data for GX31313: {'auction_closing_time': 1774972794.0, 'created_time': 1773522497.882276, 'last_price_update_time': 1774861702.039562}
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GX31313') HTTP/1.1" 204 0
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_7a34a9db9ef8b7c85ff54a2437695379.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7a34a9db9ef8b7c85ff54a2437695379.jpg not downloaded yet
2026-03-30 09:08:22 [auto1.it] INFO: Found listing with ID: SX71536
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX71536%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [auto1.it] INFO: Scrape type for SX71536: 1
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_5acb2be6dbc19efc61cf931eec88fa65.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_5acb2be6dbc19efc61cf931eec88fa65.jpg not downloaded yet
2026-03-30 09:08:22 [auto1.it] INFO: Found listing with ID: CH15776
2026-03-30 09:08:22 [auto1.it] INFO: Found listing with ID: BN09634
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN09634%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [auto1.it] INFO: Scrape type for BN09634: 2
2026-03-30 09:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac04ed90-b1ed-5505-95eb-4ef7f6d71e83 with identifier: BN09634
2026-03-30 09:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac04ed90-b1ed-5505-95eb-4ef7f6d71e83 with scrape type 2
2026-03-30 09:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac04ed90-b1ed-5505-95eb-4ef7f6d71e83 with scrape type 2
2026-03-30 09:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac04ed90-b1ed-5505-95eb-4ef7f6d71e83, identifier: BN09634
2026-03-30 09:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac04ed90-b1ed-5505-95eb-4ef7f6d71e83 with identifier: BN09634
2026-03-30 09:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac04ed90-b1ed-5505-95eb-4ef7f6d71e83 with identifier: BN09634
2026-03-30 09:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ac04ed90-b1ed-5505-95eb-4ef7f6d71e83 with identifier: BN09634 to the API
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:02:37Z',
 'fuel_type': 'diesel',
 'id': 'ac04ed90-b1ed-5505-95eb-4ef7f6d71e83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN09634',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 140307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Tech & Sound BlueMotion',
 'transmission': 'manual',
 'trim': 'Tech & Sound BlueMotion',
 'year': 2014}
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN09634%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [auto1.it] INFO: Saving data for BN09634: {'auction_closing_time': 1774969357.0, 'created_time': 1773479187.424543, 'last_price_update_time': 1774861702.628686}
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BN09634') HTTP/1.1" 204 0
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_5529cfc5b231f8098d9eec748e2d0c31.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_5529cfc5b231f8098d9eec748e2d0c31.jpg not downloaded yet
2026-03-30 09:08:22 [auto1.it] INFO: Found listing with ID: MT61619
2026-03-30 09:08:22 [auto1.it] INFO: Found listing with ID: ZF01479
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF01479%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [auto1.it] INFO: Scrape type for ZF01479: 2
2026-03-30 09:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7f1382d-8621-5828-9bc6-fbc65e61d102 with identifier: ZF01479
2026-03-30 09:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7f1382d-8621-5828-9bc6-fbc65e61d102 with scrape type 2
2026-03-30 09:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7f1382d-8621-5828-9bc6-fbc65e61d102 with scrape type 2
2026-03-30 09:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7f1382d-8621-5828-9bc6-fbc65e61d102, identifier: ZF01479
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_2f5a76218663a75ac0d49d50bf73e05b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_2f5a76218663a75ac0d49d50bf73e05b.jpg not downloaded yet
2026-03-30 09:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_68de8caabe93439d31009631fa76362a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:22 [auto1.it] INFO: Found listing with ID: MS41612
2026-03-30 09:08:22 [auto1.it] INFO: Found listing with ID: HK97988
2026-03-30 09:08:22 [auto1.it] INFO: Found listing with ID: YE07599
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE07599%27 HTTP/1.1" 200 None
2026-03-30 09:08:22 [auto1.it] INFO: Scrape type for YE07599: 2
2026-03-30 09:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa690194-ebb5-573b-bd56-0c754be51826 with identifier: YE07599
2026-03-30 09:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa690194-ebb5-573b-bd56-0c754be51826 with scrape type 2
2026-03-30 09:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa690194-ebb5-573b-bd56-0c754be51826 with scrape type 2
2026-03-30 09:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa690194-ebb5-573b-bd56-0c754be51826, identifier: YE07599
2026-03-30 09:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7f1382d-8621-5828-9bc6-fbc65e61d102 with identifier: ZF01479
2026-03-30 09:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7f1382d-8621-5828-9bc6-fbc65e61d102 with identifier: ZF01479
2026-03-30 09:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7f1382d-8621-5828-9bc6-fbc65e61d102 with identifier: ZF01479 to the API
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:08:11Z',
 'fuel_type': 'diesel',
 'id': 'f7f1382d-8621-5828-9bc6-fbc65e61d102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF01479',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 89998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-07',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF01479%27 HTTP/1.1" 200 None
2026-03-30 09:08:23 [auto1.it] INFO: Saving data for ZF01479: {'auction_closing_time': 1774969691.0, 'created_time': 1773695183.488112, 'last_price_update_time': 1774861703.591892}
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF01479') HTTP/1.1" 204 0
2026-03-30 09:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26c3410>
2026-03-30 09:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_d4ba56fa55f9dba609ef931ce5534592.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_d4ba56fa55f9dba609ef931ce5534592.jpg saved to cache
2026-03-30 09:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7234cc4b-05e8-5a36-98cc-ecae825da1db
2026-03-30 09:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_b8550a85a66fa8659a756e606487d0bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_6a1413d6c7cf2fafedee9568d59be39a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa690194-ebb5-573b-bd56-0c754be51826 with identifier: YE07599
2026-03-30 09:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa690194-ebb5-573b-bd56-0c754be51826 with identifier: YE07599
2026-03-30 09:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa690194-ebb5-573b-bd56-0c754be51826 with identifier: YE07599 to the API
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:52:56Z',
 'fuel_type': 'diesel',
 'id': 'fa690194-ebb5-573b-bd56-0c754be51826',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE07599',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 150984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-07',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE07599%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [auto1.it] INFO: Saving data for YE07599: {'auction_closing_time': 1774972376.0, 'created_time': 1774472807.082898, 'last_price_update_time': 1774861704.112728}
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YE07599') HTTP/1.1" 204 0
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_e7a167fa37cb6183427f90c1f52d4dea.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_e7a167fa37cb6183427f90c1f52d4dea.jpg not downloaded yet
2026-03-30 09:08:24 [auto1.it] INFO: Found listing with ID: ZD65327
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD65327%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [auto1.it] INFO: Scrape type for ZD65327: 2
2026-03-30 09:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f076b480-9120-5b50-9771-94f73a6b7baa with identifier: ZD65327
2026-03-30 09:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f076b480-9120-5b50-9771-94f73a6b7baa with scrape type 2
2026-03-30 09:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f076b480-9120-5b50-9771-94f73a6b7baa with scrape type 2
2026-03-30 09:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f076b480-9120-5b50-9771-94f73a6b7baa, identifier: ZD65327
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_b48351d83d13d8a621b801652ae7818b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_b48351d83d13d8a621b801652ae7818b.jpg not downloaded yet
2026-03-30 09:08:24 [auto1.it] INFO: Found listing with ID: VS38043
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS38043%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [auto1.it] INFO: Scrape type for VS38043: 2
2026-03-30 09:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae00b673-b087-51b8-ae4d-69c379cd4c80 with identifier: VS38043
2026-03-30 09:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae00b673-b087-51b8-ae4d-69c379cd4c80 with scrape type 2
2026-03-30 09:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae00b673-b087-51b8-ae4d-69c379cd4c80 with scrape type 2
2026-03-30 09:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae00b673-b087-51b8-ae4d-69c379cd4c80, identifier: VS38043
2026-03-30 09:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f076b480-9120-5b50-9771-94f73a6b7baa with identifier: ZD65327
2026-03-30 09:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f076b480-9120-5b50-9771-94f73a6b7baa with identifier: ZD65327
2026-03-30 09:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f076b480-9120-5b50-9771-94f73a6b7baa with identifier: ZD65327 to the API
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:45:28Z',
 'fuel_type': 'petrol',
 'id': 'f076b480-9120-5b50-9771-94f73a6b7baa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD65327',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 92382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-05',
 'seller_name': None,
 'title': 'Kia XCeed 1.0 TGDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2021}
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD65327%27 HTTP/1.1" 200 None
2026-03-30 09:08:24 [auto1.it] INFO: Saving data for ZD65327: {'auction_closing_time': 1774971928.0, 'created_time': 1774386489.618894, 'last_price_update_time': 1774861704.767421}
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZD65327') HTTP/1.1" 204 0
2026-03-30 09:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae00b673-b087-51b8-ae4d-69c379cd4c80 with identifier: VS38043
2026-03-30 09:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae00b673-b087-51b8-ae4d-69c379cd4c80 with identifier: VS38043
2026-03-30 09:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae00b673-b087-51b8-ae4d-69c379cd4c80 with identifier: VS38043 to the API
2026-03-30 09:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:49:48Z',
 'fuel_type': 'diesel',
 'id': 'ae00b673-b087-51b8-ae4d-69c379cd4c80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS38043',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 462954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-30',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 119 CDI extralang Select',
 'transmission': 'automatic',
 'trim': 'extralang Select',
 'year': 2018}
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS38043%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [auto1.it] INFO: Saving data for VS38043: {'auction_closing_time': 1774972188.0, 'created_time': 1774473185.2056, 'last_price_update_time': 1774861705.205578}
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VS38043') HTTP/1.1" 204 0
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_22fd96aba9d08d71c5d073d02846f850.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_22fd96aba9d08d71c5d073d02846f850.jpg not downloaded yet
2026-03-30 09:08:25 [auto1.it] INFO: Found listing with ID: KF98112
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF98112%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [auto1.it] INFO: Scrape type for KF98112: 2
2026-03-30 09:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be2122e-f261-5d56-8de1-beb149a20c28 with identifier: KF98112
2026-03-30 09:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be2122e-f261-5d56-8de1-beb149a20c28 with scrape type 2
2026-03-30 09:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be2122e-f261-5d56-8de1-beb149a20c28 with scrape type 2
2026-03-30 09:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9be2122e-f261-5d56-8de1-beb149a20c28, identifier: KF98112
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_82615f48a99ab37bc5c11e44a4c6c9a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_82615f48a99ab37bc5c11e44a4c6c9a3.jpg not downloaded yet
2026-03-30 09:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26bbb90>
2026-03-30 09:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_68de8caabe93439d31009631fa76362a.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_68de8caabe93439d31009631fa76362a.jpg saved to cache
2026-03-30 09:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd
2026-03-30 09:08:25 [auto1.it] INFO: Found listing with ID: ZF95958
2026-03-30 09:08:25 [auto1.it] INFO: Found listing with ID: GD26025
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD26025%27 HTTP/1.1" 200 None
2026-03-30 09:08:25 [auto1.it] INFO: Scrape type for GD26025: 2
2026-03-30 09:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07abb00b-1303-5dd6-a8e6-88018d312dce with identifier: GD26025
2026-03-30 09:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07abb00b-1303-5dd6-a8e6-88018d312dce with scrape type 2
2026-03-30 09:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07abb00b-1303-5dd6-a8e6-88018d312dce with scrape type 2
2026-03-30 09:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 07abb00b-1303-5dd6-a8e6-88018d312dce, identifier: GD26025
2026-03-30 09:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9be2122e-f261-5d56-8de1-beb149a20c28 with identifier: KF98112
2026-03-30 09:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9be2122e-f261-5d56-8de1-beb149a20c28 with identifier: KF98112
2026-03-30 09:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9be2122e-f261-5d56-8de1-beb149a20c28 with identifier: KF98112 to the API
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:46:05Z',
 'fuel_type': 'diesel',
 'id': '9be2122e-f261-5d56-8de1-beb149a20c28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF98112',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 281144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-28',
 'seller_name': None,
 'title': 'BMW 5er 535d GT xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2013}
2026-03-30 09:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF98112%27 HTTP/1.1" 200 None
2026-03-30 09:08:26 [auto1.it] INFO: Saving data for KF98112: {'auction_closing_time': 1774971965.0, 'created_time': 1773997726.465073, 'last_price_update_time': 1774861706.010869}
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KF98112') HTTP/1.1" 204 0
2026-03-30 09:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2727350>
2026-03-30 09:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_b8550a85a66fa8659a756e606487d0bd.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_b8550a85a66fa8659a756e606487d0bd.jpg saved to cache
2026-03-30 09:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7234cc4b-05e8-5a36-98cc-ecae825da1db
2026-03-30 09:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2704490>
2026-03-30 09:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_6a1413d6c7cf2fafedee9568d59be39a.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_6a1413d6c7cf2fafedee9568d59be39a.jpg saved to cache
2026-03-30 09:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd
2026-03-30 09:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_2f5a76218663a75ac0d49d50bf73e05b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_5acb2be6dbc19efc61cf931eec88fa65.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 07abb00b-1303-5dd6-a8e6-88018d312dce with identifier: GD26025
2026-03-30 09:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 07abb00b-1303-5dd6-a8e6-88018d312dce with identifier: GD26025
2026-03-30 09:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 07abb00b-1303-5dd6-a8e6-88018d312dce with identifier: GD26025 to the API
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:59:33Z',
 'fuel_type': 'petrol',
 'id': '07abb00b-1303-5dd6-a8e6-88018d312dce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD26025',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 121904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-19',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2014}
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD26025%27 HTTP/1.1" 200 None
2026-03-30 09:08:26 [auto1.it] INFO: Saving data for GD26025: {'auction_closing_time': 1774972773.0, 'created_time': 1773236639.328309, 'last_price_update_time': 1774861706.598216}
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GD26025') HTTP/1.1" 204 0
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_a263865ce47f62d698f60f02a197a62b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_a263865ce47f62d698f60f02a197a62b.jpg not downloaded yet
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: UY95940
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: SP08932
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: RZ71540
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: LX93487
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: LZ42897
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: SE28120
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE28120%27 HTTP/1.1" 200 None
2026-03-30 09:08:26 [auto1.it] INFO: Scrape type for SE28120: 2
2026-03-30 09:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f7889f2-2e0b-53c2-b17b-c672998c97d9 with identifier: SE28120
2026-03-30 09:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f7889f2-2e0b-53c2-b17b-c672998c97d9 with scrape type 2
2026-03-30 09:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f7889f2-2e0b-53c2-b17b-c672998c97d9 with scrape type 2
2026-03-30 09:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f7889f2-2e0b-53c2-b17b-c672998c97d9, identifier: SE28120
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_5f51b9644d280b09d34cd16ab5e433de.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_5f51b9644d280b09d34cd16ab5e433de.jpg not downloaded yet
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: PN24411
2026-03-30 09:08:26 [auto1.it] INFO: Found listing with ID: RN34673
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN34673%27 HTTP/1.1" 200 None
2026-03-30 09:08:26 [auto1.it] INFO: Scrape type for RN34673: 2
2026-03-30 09:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209b5af8-615a-527f-a45e-1572fb13a2bf with identifier: RN34673
2026-03-30 09:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209b5af8-615a-527f-a45e-1572fb13a2bf with scrape type 2
2026-03-30 09:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 209b5af8-615a-527f-a45e-1572fb13a2bf with scrape type 2
2026-03-30 09:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 209b5af8-615a-527f-a45e-1572fb13a2bf, identifier: RN34673
2026-03-30 09:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f7889f2-2e0b-53c2-b17b-c672998c97d9 with identifier: SE28120
2026-03-30 09:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f7889f2-2e0b-53c2-b17b-c672998c97d9 with identifier: SE28120
2026-03-30 09:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f7889f2-2e0b-53c2-b17b-c672998c97d9 with identifier: SE28120 to the API
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:43:41Z',
 'fuel_type': 'diesel',
 'id': '9f7889f2-2e0b-53c2-b17b-c672998c97d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE28120',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 213692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-17',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 310 L1 Sport',
 'transmission': 'automatic',
 'trim': '310 L1 Sport',
 'year': 2019}
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE28120%27 HTTP/1.1" 200 None
2026-03-30 09:08:27 [auto1.it] INFO: Saving data for SE28120: {'auction_closing_time': 1774971821.0, 'created_time': 1774002018.605469, 'last_price_update_time': 1774861707.334236}
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SE28120') HTTP/1.1" 204 0
2026-03-30 09:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_b48351d83d13d8a621b801652ae7818b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_e7a167fa37cb6183427f90c1f52d4dea.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 209b5af8-615a-527f-a45e-1572fb13a2bf with identifier: RN34673
2026-03-30 09:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 209b5af8-615a-527f-a45e-1572fb13a2bf with identifier: RN34673
2026-03-30 09:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 209b5af8-615a-527f-a45e-1572fb13a2bf with identifier: RN34673 to the API
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:40:35Z',
 'fuel_type': 'petrol',
 'id': '209b5af8-615a-527f-a45e-1572fb13a2bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN34673',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 117889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Login',
 'transmission': 'manual',
 'trim': 'Login',
 'year': 2017}
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN34673%27 HTTP/1.1" 200 None
2026-03-30 09:08:27 [auto1.it] INFO: Saving data for RN34673: {'auction_closing_time': 1774971635.0, 'created_time': 1774473093.125255, 'last_price_update_time': 1774861707.697605}
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RN34673') HTTP/1.1" 204 0
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_a5018c386d351ebed42390c073c968d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_a5018c386d351ebed42390c073c968d5.jpg not downloaded yet
2026-03-30 09:08:27 [auto1.it] INFO: Found listing with ID: WV68321
2026-03-30 09:08:27 [auto1.it] INFO: Found listing with ID: ZK24441
2026-03-30 09:08:27 [auto1.it] INFO: Found listing with ID: GW20152
2026-03-30 09:08:27 [auto1.it] INFO: Found listing with ID: UL18238
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL18238%27 HTTP/1.1" 200 None
2026-03-30 09:08:27 [auto1.it] INFO: Scrape type for UL18238: 2
2026-03-30 09:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0bf2c2-f36f-584a-8369-724405605674 with identifier: UL18238
2026-03-30 09:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0bf2c2-f36f-584a-8369-724405605674 with scrape type 2
2026-03-30 09:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0bf2c2-f36f-584a-8369-724405605674 with scrape type 2
2026-03-30 09:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ed0bf2c2-f36f-584a-8369-724405605674, identifier: UL18238
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_ad235cbbae0f7d312b46902e14b3893c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_ad235cbbae0f7d312b46902e14b3893c.jpg not downloaded yet
2026-03-30 09:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR96583> (referer: https://www.auto1.com/v1/car-details-view/VR96583/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:27 [auto1.it] INFO: Found listing with ID: SJ91765
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ91765%27 HTTP/1.1" 200 None
2026-03-30 09:08:27 [auto1.it] INFO: Scrape type for SJ91765: 2
2026-03-30 09:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53d2b266-c972-5545-af8a-75ce696d40e2 with identifier: SJ91765
2026-03-30 09:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53d2b266-c972-5545-af8a-75ce696d40e2 with scrape type 2
2026-03-30 09:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53d2b266-c972-5545-af8a-75ce696d40e2 with scrape type 2
2026-03-30 09:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 53d2b266-c972-5545-af8a-75ce696d40e2, identifier: SJ91765
2026-03-30 09:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ed0bf2c2-f36f-584a-8369-724405605674 with identifier: UL18238
2026-03-30 09:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ed0bf2c2-f36f-584a-8369-724405605674 with identifier: UL18238
2026-03-30 09:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ed0bf2c2-f36f-584a-8369-724405605674 with identifier: UL18238 to the API
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:52:06Z',
 'fuel_type': 'petrol',
 'id': 'ed0bf2c2-f36f-584a-8369-724405605674',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL18238',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 207135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-27',
 'seller_name': None,
 'title': 'Audi A6 55 TFSI Mild-Hybrid quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL18238%27 HTTP/1.1" 200 None
2026-03-30 09:08:28 [auto1.it] INFO: Saving data for UL18238: {'auction_closing_time': 1774972326.0, 'created_time': 1774602407.763406, 'last_price_update_time': 1774861708.357744}
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL18238') HTTP/1.1" 204 0
2026-03-30 09:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1160910>
2026-03-30 09:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_2f5a76218663a75ac0d49d50bf73e05b.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_2f5a76218663a75ac0d49d50bf73e05b.jpg saved to cache
2026-03-30 09:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd
2026-03-30 09:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26badd0>
2026-03-30 09:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_5acb2be6dbc19efc61cf931eec88fa65.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_5acb2be6dbc19efc61cf931eec88fa65.jpg saved to cache
2026-03-30 09:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd
2026-03-30 09:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 53d2b266-c972-5545-af8a-75ce696d40e2 with identifier: SJ91765
2026-03-30 09:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 53d2b266-c972-5545-af8a-75ce696d40e2 with identifier: SJ91765
2026-03-30 09:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 53d2b266-c972-5545-af8a-75ce696d40e2 with identifier: SJ91765 to the API
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:22:05Z',
 'fuel_type': 'diesel',
 'id': '53d2b266-c972-5545-af8a-75ce696d40e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ91765',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 193951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-13',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ91765%27 HTTP/1.1" 200 None
2026-03-30 09:08:28 [auto1.it] INFO: Saving data for SJ91765: {'auction_closing_time': 1774970525.0, 'created_time': 1773304921.327941, 'last_price_update_time': 1774861708.922059}
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SJ91765') HTTP/1.1" 204 0
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_7c1dda8a7285d20051356657f8da601c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7c1dda8a7285d20051356657f8da601c.jpg not downloaded yet
2026-03-30 09:08:28 [auto1.it] INFO: Found listing with ID: FW39632
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW39632%27 HTTP/1.1" 200 None
2026-03-30 09:08:28 [auto1.it] INFO: Scrape type for FW39632: 2
2026-03-30 09:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2734eb02-5596-5197-8623-f568d24d0dc2 with identifier: FW39632
2026-03-30 09:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2734eb02-5596-5197-8623-f568d24d0dc2 with scrape type 2
2026-03-30 09:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2734eb02-5596-5197-8623-f568d24d0dc2 with scrape type 2
2026-03-30 09:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2734eb02-5596-5197-8623-f568d24d0dc2, identifier: FW39632
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_90eb8d49fe9c7fe014afe20582aa6862.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_90eb8d49fe9c7fe014afe20582aa6862.jpg not downloaded yet
2026-03-30 09:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH80469/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_22fd96aba9d08d71c5d073d02846f850.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: ZP51405
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: PE97517
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: UK55299
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: UE49682
2026-03-30 09:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2734eb02-5596-5197-8623-f568d24d0dc2 with identifier: FW39632
2026-03-30 09:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2734eb02-5596-5197-8623-f568d24d0dc2 with identifier: FW39632
2026-03-30 09:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2734eb02-5596-5197-8623-f568d24d0dc2 with identifier: FW39632 to the API
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:47:08Z',
 'fuel_type': 'diesel',
 'id': '2734eb02-5596-5197-8623-f568d24d0dc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW39632',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 171134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-01',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW39632%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [auto1.it] INFO: Saving data for FW39632: {'auction_closing_time': 1774972028.0, 'created_time': 1772783784.846393, 'last_price_update_time': 1774861709.40577}
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FW39632') HTTP/1.1" 204 0
2026-03-30 09:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26b9910>
2026-03-30 09:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_b48351d83d13d8a621b801652ae7818b.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_b48351d83d13d8a621b801652ae7818b.jpg saved to cache
2026-03-30 09:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd
2026-03-30 09:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2734950>
2026-03-30 09:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_e7a167fa37cb6183427f90c1f52d4dea.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_e7a167fa37cb6183427f90c1f52d4dea.jpg saved to cache
2026-03-30 09:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7234cc4b-05e8-5a36-98cc-ecae825da1db
2026-03-30 09:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_5f51b9644d280b09d34cd16ab5e433de.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_a263865ce47f62d698f60f02a197a62b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_82615f48a99ab37bc5c11e44a4c6c9a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: PE82748
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: YY05458
2026-03-30 09:08:29 [auto1.it] INFO: Found listing with ID: PT71441
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT71441%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [auto1.it] INFO: Scrape type for PT71441: 2
2026-03-30 09:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2100a4d-c25c-5cf5-a0a0-6360a5b0fc79 with identifier: PT71441
2026-03-30 09:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2100a4d-c25c-5cf5-a0a0-6360a5b0fc79 with scrape type 2
2026-03-30 09:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2100a4d-c25c-5cf5-a0a0-6360a5b0fc79 with scrape type 2
2026-03-30 09:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d2100a4d-c25c-5cf5-a0a0-6360a5b0fc79, identifier: PT71441
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_51faf5ecec3e3f77d2aa6f6fc9200536.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_51faf5ecec3e3f77d2aa6f6fc9200536.jpg not downloaded yet
2026-03-30 09:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d2100a4d-c25c-5cf5-a0a0-6360a5b0fc79 with identifier: PT71441
2026-03-30 09:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d2100a4d-c25c-5cf5-a0a0-6360a5b0fc79 with identifier: PT71441
2026-03-30 09:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d2100a4d-c25c-5cf5-a0a0-6360a5b0fc79 with identifier: PT71441 to the API
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:43:52Z',
 'fuel_type': 'petrol',
 'id': 'd2100a4d-c25c-5cf5-a0a0-6360a5b0fc79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT71441',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 27786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-29',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2023}
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT71441%27 HTTP/1.1" 200 None
2026-03-30 09:08:30 [auto1.it] INFO: Saving data for PT71441: {'auction_closing_time': 1774971832.0, 'created_time': 1773231489.864404, 'last_price_update_time': 1774861710.090794}
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PT71441') HTTP/1.1" 204 0
2026-03-30 09:08:30 [auto1.it] INFO: Channel: 24h | Page: 12 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18bb6a2c-a034-5ce2-91fc-f8923807dd0d with identifier: VR96583
2026-03-30 09:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d with scrape type 1
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_d7ddb3b2946343d3517b65a9ab17e610.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_d7ddb3b2946343d3517b65a9ab17e610.jpg not downloaded yet
2026-03-30 09:08:30 [auto1.it] INFO: Found listing with ID: DZ81200
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ81200%27 HTTP/1.1" 200 None
2026-03-30 09:08:30 [auto1.it] INFO: Scrape type for DZ81200: 2
2026-03-30 09:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a9ee02d-725d-55ab-b325-de5d94980936 with identifier: DZ81200
2026-03-30 09:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a9ee02d-725d-55ab-b325-de5d94980936 with scrape type 2
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a9ee02d-725d-55ab-b325-de5d94980936 with scrape type 2
2026-03-30 09:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0a9ee02d-725d-55ab-b325-de5d94980936, identifier: DZ81200
2026-03-30 09:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX71536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48d1a90>
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_22fd96aba9d08d71c5d073d02846f850.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_22fd96aba9d08d71c5d073d02846f850.jpg saved to cache
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7234cc4b-05e8-5a36-98cc-ecae825da1db
2026-03-30 09:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_ad235cbbae0f7d312b46902e14b3893c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_a5018c386d351ebed42390c073c968d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0a9ee02d-725d-55ab-b325-de5d94980936 with identifier: DZ81200
2026-03-30 09:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0a9ee02d-725d-55ab-b325-de5d94980936 with identifier: DZ81200
2026-03-30 09:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0a9ee02d-725d-55ab-b325-de5d94980936 with identifier: DZ81200 to the API
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-31T15:51:59Z',
 'fuel_type': 'hybrid',
 'id': '0a9ee02d-725d-55ab-b325-de5d94980936',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ81200',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 55586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-05',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2021}
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ81200%27 HTTP/1.1" 200 None
2026-03-30 09:08:30 [auto1.it] INFO: Saving data for DZ81200: {'auction_closing_time': 1774972319.0, 'created_time': 1774386505.939422, 'last_price_update_time': 1774861710.689653}
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DZ81200') HTTP/1.1" 204 0
2026-03-30 09:08:30 [auto1.it] INFO: Found listing with ID: CM62235
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM62235%27 HTTP/1.1" 200 None
2026-03-30 09:08:30 [auto1.it] INFO: Scrape type for CM62235: 2
2026-03-30 09:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2625a824-d6a3-5ec7-a269-233e75f4d886 with identifier: CM62235
2026-03-30 09:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2625a824-d6a3-5ec7-a269-233e75f4d886 with scrape type 2
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2625a824-d6a3-5ec7-a269-233e75f4d886 with scrape type 2
2026-03-30 09:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2625a824-d6a3-5ec7-a269-233e75f4d886, identifier: CM62235
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_b891e7da162cb83915fb7ab3c3355bc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_b891e7da162cb83915fb7ab3c3355bc7.jpg not downloaded yet
2026-03-30 09:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1432fd0>
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_5f51b9644d280b09d34cd16ab5e433de.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_5f51b9644d280b09d34cd16ab5e433de.jpg saved to cache
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee268b890>
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_a263865ce47f62d698f60f02a197a62b.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_a263865ce47f62d698f60f02a197a62b.jpg saved to cache
2026-03-30 09:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7234cc4b-05e8-5a36-98cc-ecae825da1db
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1445690>
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_82615f48a99ab37bc5c11e44a4c6c9a3.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_82615f48a99ab37bc5c11e44a4c6c9a3.jpg saved to cache
2026-03-30 09:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd
2026-03-30 09:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7c1dda8a7285d20051356657f8da601c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: BJ35164
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: SJ10384
2026-03-30 09:08:31 [auto1.it] INFO: Found listing with ID: PL88516
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL88516%27 HTTP/1.1" 200 None
2026-03-30 09:08:31 [auto1.it] INFO: Scrape type for PL88516: 2
2026-03-30 09:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eecbd3b4-32b5-5999-96c0-da15a242efcd with identifier: PL88516
2026-03-30 09:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eecbd3b4-32b5-5999-96c0-da15a242efcd with scrape type 2
2026-03-30 09:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eecbd3b4-32b5-5999-96c0-da15a242efcd with scrape type 2
2026-03-30 09:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eecbd3b4-32b5-5999-96c0-da15a242efcd, identifier: PL88516
2026-03-30 09:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2625a824-d6a3-5ec7-a269-233e75f4d886 with identifier: CM62235
2026-03-30 09:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2625a824-d6a3-5ec7-a269-233e75f4d886 with identifier: CM62235
2026-03-30 09:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2625a824-d6a3-5ec7-a269-233e75f4d886 with identifier: CM62235 to the API
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:57:28Z',
 'fuel_type': 'diesel',
 'id': '2625a824-d6a3-5ec7-a269-233e75f4d886',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM62235',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Qubo',
 'odometer': 296764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-17',
 'seller_name': None,
 'title': 'Fiat Qubo 1.3 JTD MyLife',
 'transmission': 'manual',
 'trim': 'MyLife',
 'year': 2011}
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM62235%27 HTTP/1.1" 200 None
2026-03-30 09:08:31 [auto1.it] INFO: Saving data for CM62235: {'auction_closing_time': 1774972648.0, 'created_time': 1773268187.969014, 'last_price_update_time': 1774861711.928511}
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CM62235') HTTP/1.1" 204 0
2026-03-30 09:08:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eecbd3b4-32b5-5999-96c0-da15a242efcd with identifier: PL88516
2026-03-30 09:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eecbd3b4-32b5-5999-96c0-da15a242efcd with identifier: PL88516
2026-03-30 09:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eecbd3b4-32b5-5999-96c0-da15a242efcd with identifier: PL88516 to the API
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:12:44Z',
 'fuel_type': 'diesel',
 'id': 'eecbd3b4-32b5-5999-96c0-da15a242efcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL88516',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 149610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seller_name': None,
 'title': 'BMW 3er 320d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2016}
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL88516%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Saving data for PL88516: {'auction_closing_time': 1774969964.0, 'created_time': 1774440370.051176, 'last_price_update_time': 1774861712.409289}
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PL88516') HTTP/1.1" 204 0
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: NG07362
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG07362%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Scrape type for NG07362: 1
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_2cd59799ad2ab2fe56235b037d3833b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_2cd59799ad2ab2fe56235b037d3833b0.jpg not downloaded yet
2026-03-30 09:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_90eb8d49fe9c7fe014afe20582aa6862.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:32 [auto1.it] INFO: Found listing with ID: SC57699
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC57699%27 HTTP/1.1" 200 None
2026-03-30 09:08:32 [auto1.it] INFO: Scrape type for SC57699: 2
2026-03-30 09:08:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9f88a89-9cb9-5fee-a428-873f9296b02d with identifier: SC57699
2026-03-30 09:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9f88a89-9cb9-5fee-a428-873f9296b02d with scrape type 2
2026-03-30 09:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9f88a89-9cb9-5fee-a428-873f9296b02d with scrape type 2
2026-03-30 09:08:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d9f88a89-9cb9-5fee-a428-873f9296b02d, identifier: SC57699
2026-03-30 09:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2688650>
2026-03-30 09:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_ad235cbbae0f7d312b46902e14b3893c.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_ad235cbbae0f7d312b46902e14b3893c.jpg saved to cache
2026-03-30 09:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd
2026-03-30 09:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11b9b10>
2026-03-30 09:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_a5018c386d351ebed42390c073c968d5.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_a5018c386d351ebed42390c073c968d5.jpg saved to cache
2026-03-30 09:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7234cc4b-05e8-5a36-98cc-ecae825da1db
2026-03-30 09:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d9f88a89-9cb9-5fee-a428-873f9296b02d with identifier: SC57699
2026-03-30 09:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d9f88a89-9cb9-5fee-a428-873f9296b02d with identifier: SC57699
2026-03-30 09:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d9f88a89-9cb9-5fee-a428-873f9296b02d with identifier: SC57699 to the API
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:10:59Z',
 'fuel_type': 'gas',
 'id': 'd9f88a89-9cb9-5fee-a428-873f9296b02d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC57699',
 'listing': 'auction',
 'make': 'DR',
 'model': 'DR 4.0',
 'odometer': 169130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': None,
 'title': 'DR DR 4.0 1.5 LPG',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC57699%27 HTTP/1.1" 200 None
2026-03-30 09:08:33 [auto1.it] INFO: Saving data for SC57699: {'auction_closing_time': 1774969859.0, 'created_time': 1774472761.276079, 'last_price_update_time': 1774861713.077613}
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC57699') HTTP/1.1" 204 0
2026-03-30 09:08:33 [auto1.it] INFO: Found listing with ID: SK65228
2026-03-30 09:08:33 [auto1.it] INFO: Found listing with ID: YY30219
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY30219%27 HTTP/1.1" 200 None
2026-03-30 09:08:33 [auto1.it] INFO: Scrape type for YY30219: 2
2026-03-30 09:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 256b558c-d897-5cad-b105-2aa7659efb53 with identifier: YY30219
2026-03-30 09:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 256b558c-d897-5cad-b105-2aa7659efb53 with scrape type 2
2026-03-30 09:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 256b558c-d897-5cad-b105-2aa7659efb53 with scrape type 2
2026-03-30 09:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 256b558c-d897-5cad-b105-2aa7659efb53, identifier: YY30219
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_929e3550f7e8b2945426a54a99036642.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_929e3550f7e8b2945426a54a99036642.jpg not downloaded yet
2026-03-30 09:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25a4450>
2026-03-30 09:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_7c1dda8a7285d20051356657f8da601c.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7c1dda8a7285d20051356657f8da601c.jpg saved to cache
2026-03-30 09:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7234cc4b-05e8-5a36-98cc-ecae825da1db
2026-03-30 09:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_d7ddb3b2946343d3517b65a9ab17e610.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:33 [auto1.it] INFO: Found listing with ID: UY23152
2026-03-30 09:08:33 [auto1.it] INFO: Found listing with ID: RK33520
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK33520%27 HTTP/1.1" 200 None
2026-03-30 09:08:33 [auto1.it] INFO: Scrape type for RK33520: 2
2026-03-30 09:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8a28b0b-d9f2-5013-b5eb-be196f7cdb9c with identifier: RK33520
2026-03-30 09:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8a28b0b-d9f2-5013-b5eb-be196f7cdb9c with scrape type 2
2026-03-30 09:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8a28b0b-d9f2-5013-b5eb-be196f7cdb9c with scrape type 2
2026-03-30 09:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c8a28b0b-d9f2-5013-b5eb-be196f7cdb9c, identifier: RK33520
2026-03-30 09:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 256b558c-d897-5cad-b105-2aa7659efb53 with identifier: YY30219
2026-03-30 09:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 256b558c-d897-5cad-b105-2aa7659efb53 with identifier: YY30219
2026-03-30 09:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 256b558c-d897-5cad-b105-2aa7659efb53 with identifier: YY30219 to the API
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:03Z',
 'fuel_type': 'diesel',
 'id': '256b558c-d897-5cad-b105-2aa7659efb53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY30219',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 211359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY30219%27 HTTP/1.1" 200 None
2026-03-30 09:08:33 [auto1.it] INFO: Saving data for YY30219: {'auction_closing_time': 1774972683.0, 'created_time': 1774440404.866449, 'last_price_update_time': 1774861713.782414}
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY30219') HTTP/1.1" 204 0
2026-03-30 09:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c8a28b0b-d9f2-5013-b5eb-be196f7cdb9c with identifier: RK33520
2026-03-30 09:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c8a28b0b-d9f2-5013-b5eb-be196f7cdb9c with identifier: RK33520
2026-03-30 09:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c8a28b0b-d9f2-5013-b5eb-be196f7cdb9c with identifier: RK33520 to the API
2026-03-30 09:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:37:23Z',
 'fuel_type': 'petrol',
 'id': 'c8a28b0b-d9f2-5013-b5eb-be196f7cdb9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK33520',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 62222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid XLine 2WD',
 'transmission': 'automatic',
 'trim': 'XLine 2WD',
 'year': 2021}
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK33520%27 HTTP/1.1" 200 None
2026-03-30 09:08:34 [auto1.it] INFO: Saving data for RK33520: {'auction_closing_time': 1774971443.0, 'created_time': 1773695427.836449, 'last_price_update_time': 1774861714.203703}
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RK33520') HTTP/1.1" 204 0
2026-03-30 09:08:34 [auto1.it] INFO: Found listing with ID: CE85446
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE85446%27 HTTP/1.1" 200 None
2026-03-30 09:08:34 [auto1.it] INFO: Scrape type for CE85446: 2
2026-03-30 09:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8572dd08-9ee7-51cb-b041-100fa6da85e1 with identifier: CE85446
2026-03-30 09:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8572dd08-9ee7-51cb-b041-100fa6da85e1 with scrape type 2
2026-03-30 09:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8572dd08-9ee7-51cb-b041-100fa6da85e1 with scrape type 2
2026-03-30 09:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8572dd08-9ee7-51cb-b041-100fa6da85e1, identifier: CE85446
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_81895f4ffb7519ce2503bfd941e14a87.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_81895f4ffb7519ce2503bfd941e14a87.jpg not downloaded yet
2026-03-30 09:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2774d50>
2026-03-30 09:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_90eb8d49fe9c7fe014afe20582aa6862.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_90eb8d49fe9c7fe014afe20582aa6862.jpg saved to cache
2026-03-30 09:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd
2026-03-30 09:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_b891e7da162cb83915fb7ab3c3355bc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:34 [auto1.it] INFO: Found listing with ID: UP66451
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP66451%27 HTTP/1.1" 200 None
2026-03-30 09:08:34 [auto1.it] INFO: Scrape type for UP66451: 2
2026-03-30 09:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a97e4b20-72f7-5ef8-8408-5bea6a0a5444 with identifier: UP66451
2026-03-30 09:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a97e4b20-72f7-5ef8-8408-5bea6a0a5444 with scrape type 2
2026-03-30 09:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a97e4b20-72f7-5ef8-8408-5bea6a0a5444 with scrape type 2
2026-03-30 09:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a97e4b20-72f7-5ef8-8408-5bea6a0a5444, identifier: UP66451
2026-03-30 09:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8572dd08-9ee7-51cb-b041-100fa6da85e1 with identifier: CE85446
2026-03-30 09:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8572dd08-9ee7-51cb-b041-100fa6da85e1 with identifier: CE85446
2026-03-30 09:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8572dd08-9ee7-51cb-b041-100fa6da85e1 with identifier: CE85446 to the API
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:20:00Z',
 'fuel_type': 'diesel',
 'id': '8572dd08-9ee7-51cb-b041-100fa6da85e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE85446',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 352927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-13',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'automatic',
 'trim': 'Kinetic 2WD',
 'year': 2015}
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE85446%27 HTTP/1.1" 200 None
2026-03-30 09:08:34 [auto1.it] INFO: Saving data for CE85446: {'auction_closing_time': 1774970400.0, 'created_time': 1773954357.756112, 'last_price_update_time': 1774861714.93357}
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CE85446') HTTP/1.1" 204 0
2026-03-30 09:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a97e4b20-72f7-5ef8-8408-5bea6a0a5444 with identifier: UP66451
2026-03-30 09:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a97e4b20-72f7-5ef8-8408-5bea6a0a5444 with identifier: UP66451
2026-03-30 09:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a97e4b20-72f7-5ef8-8408-5bea6a0a5444 with identifier: UP66451 to the API
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:43:56Z',
 'fuel_type': 'diesel',
 'id': 'a97e4b20-72f7-5ef8-8408-5bea6a0a5444',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP66451',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 307777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-12',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP66451%27 HTTP/1.1" 200 None
2026-03-30 09:08:35 [auto1.it] INFO: Saving data for UP66451: {'auction_closing_time': 1774971836.0, 'created_time': 1773954815.978308, 'last_price_update_time': 1774861715.323763}
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UP66451') HTTP/1.1" 204 0
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: HU51059
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: XN46207
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN46207%27 HTTP/1.1" 200 None
2026-03-30 09:08:35 [auto1.it] INFO: Scrape type for XN46207: 2
2026-03-30 09:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8512537c-a6e3-5848-86ed-cb7884a9337c with identifier: XN46207
2026-03-30 09:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8512537c-a6e3-5848-86ed-cb7884a9337c with scrape type 2
2026-03-30 09:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8512537c-a6e3-5848-86ed-cb7884a9337c with scrape type 2
2026-03-30 09:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8512537c-a6e3-5848-86ed-cb7884a9337c, identifier: XN46207
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_7eb6e98f8455d0c76851d2303640febc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_7eb6e98f8455d0c76851d2303640febc.jpg not downloaded yet
2026-03-30 09:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26b7150>
2026-03-30 09:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_d7ddb3b2946343d3517b65a9ab17e610.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_d7ddb3b2946343d3517b65a9ab17e610.jpg saved to cache
2026-03-30 09:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d
2026-03-30 09:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_2cd59799ad2ab2fe56235b037d3833b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:35 [auto1.it] INFO: Found listing with ID: AE31904
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE31904%27 HTTP/1.1" 200 None
2026-03-30 09:08:35 [auto1.it] INFO: Scrape type for AE31904: 2
2026-03-30 09:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73f2d2b1-5183-52c4-8c4b-a1a0557d67ad with identifier: AE31904
2026-03-30 09:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73f2d2b1-5183-52c4-8c4b-a1a0557d67ad with scrape type 2
2026-03-30 09:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73f2d2b1-5183-52c4-8c4b-a1a0557d67ad with scrape type 2
2026-03-30 09:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73f2d2b1-5183-52c4-8c4b-a1a0557d67ad, identifier: AE31904
2026-03-30 09:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8512537c-a6e3-5848-86ed-cb7884a9337c with identifier: XN46207
2026-03-30 09:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8512537c-a6e3-5848-86ed-cb7884a9337c with identifier: XN46207
2026-03-30 09:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8512537c-a6e3-5848-86ed-cb7884a9337c with identifier: XN46207 to the API
2026-03-30 09:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:35:53Z',
 'fuel_type': 'petrol',
 'id': '8512537c-a6e3-5848-86ed-cb7884a9337c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN46207',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 154038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN46207%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Saving data for XN46207: {'auction_closing_time': 1774971353.0, 'created_time': 1774440347.83274, 'last_price_update_time': 1774861716.394534}
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XN46207') HTTP/1.1" 204 0
2026-03-30 09:08:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73f2d2b1-5183-52c4-8c4b-a1a0557d67ad with identifier: AE31904
2026-03-30 09:08:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73f2d2b1-5183-52c4-8c4b-a1a0557d67ad with identifier: AE31904
2026-03-30 09:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73f2d2b1-5183-52c4-8c4b-a1a0557d67ad with identifier: AE31904 to the API
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:16:30Z',
 'fuel_type': 'diesel',
 'id': '73f2d2b1-5183-52c4-8c4b-a1a0557d67ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE31904',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 239143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-22',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE31904%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Saving data for AE31904: {'auction_closing_time': 1774970190.0, 'created_time': 1774386650.189443, 'last_price_update_time': 1774861716.880874}
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AE31904') HTTP/1.1" 204 0
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: KM32276
2026-03-30 09:08:36 [auto1.it] INFO: Found listing with ID: WX63891
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX63891%27 HTTP/1.1" 200 None
2026-03-30 09:08:36 [auto1.it] INFO: Scrape type for WX63891: 2
2026-03-30 09:08:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e9e766f-8520-52c1-9875-03a0c6242dc0 with identifier: WX63891
2026-03-30 09:08:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e9e766f-8520-52c1-9875-03a0c6242dc0 with scrape type 2
2026-03-30 09:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e9e766f-8520-52c1-9875-03a0c6242dc0 with scrape type 2
2026-03-30 09:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e9e766f-8520-52c1-9875-03a0c6242dc0, identifier: WX63891
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_665589895d0e6ba376654e5e9b8db372.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_665589895d0e6ba376654e5e9b8db372.jpg not downloaded yet
2026-03-30 09:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_929e3550f7e8b2945426a54a99036642.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: YD69263
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: ZR63557
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: ZH41426
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: EB41992
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: ZU58550
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: BF27617
2026-03-30 09:08:37 [auto1.it] INFO: Found listing with ID: WU44715
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU44715%27 HTTP/1.1" 200 None
2026-03-30 09:08:37 [auto1.it] INFO: Scrape type for WU44715: 2
2026-03-30 09:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d721f47d-57e5-55a3-8aa0-58763cd691dd with identifier: WU44715
2026-03-30 09:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d721f47d-57e5-55a3-8aa0-58763cd691dd with scrape type 2
2026-03-30 09:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d721f47d-57e5-55a3-8aa0-58763cd691dd with scrape type 2
2026-03-30 09:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d721f47d-57e5-55a3-8aa0-58763cd691dd, identifier: WU44715
2026-03-30 09:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e9e766f-8520-52c1-9875-03a0c6242dc0 with identifier: WX63891
2026-03-30 09:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e9e766f-8520-52c1-9875-03a0c6242dc0 with identifier: WX63891
2026-03-30 09:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e9e766f-8520-52c1-9875-03a0c6242dc0 with identifier: WX63891 to the API
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:01:09Z',
 'fuel_type': 'diesel',
 'id': '5e9e766f-8520-52c1-9875-03a0c6242dc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX63891',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 102089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-23',
 'seller_name': None,
 'title': 'Fiat 500X 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX63891%27 HTTP/1.1" 200 None
2026-03-30 09:08:37 [auto1.it] INFO: Saving data for WX63891: {'auction_closing_time': 1774969269.0, 'created_time': 1773522466.581813, 'last_price_update_time': 1774861717.577516}
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WX63891') HTTP/1.1" 204 0
2026-03-30 09:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee4599410>
2026-03-30 09:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_b891e7da162cb83915fb7ab3c3355bc7.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_b891e7da162cb83915fb7ab3c3355bc7.jpg saved to cache
2026-03-30 09:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d
2026-03-30 09:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d721f47d-57e5-55a3-8aa0-58763cd691dd with identifier: WU44715
2026-03-30 09:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d721f47d-57e5-55a3-8aa0-58763cd691dd with identifier: WU44715
2026-03-30 09:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d721f47d-57e5-55a3-8aa0-58763cd691dd with identifier: WU44715 to the API
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:27:14Z',
 'fuel_type': 'diesel',
 'id': 'd721f47d-57e5-55a3-8aa0-58763cd691dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU44715',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 373429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 250 CDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2014}
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU44715%27 HTTP/1.1" 200 None
2026-03-30 09:08:37 [auto1.it] INFO: Saving data for WU44715: {'auction_closing_time': 1774970834.0, 'created_time': 1773749583.466091, 'last_price_update_time': 1774861717.997558}
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WU44715') HTTP/1.1" 204 0
2026-03-30 09:08:38 [auto1.it] INFO: Found listing with ID: EN15125
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN15125%27 HTTP/1.1" 200 None
2026-03-30 09:08:38 [auto1.it] INFO: Scrape type for EN15125: 2
2026-03-30 09:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce8801b-c2cb-59b0-b239-45866c357ce8 with identifier: EN15125
2026-03-30 09:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce8801b-c2cb-59b0-b239-45866c357ce8 with scrape type 2
2026-03-30 09:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ce8801b-c2cb-59b0-b239-45866c357ce8 with scrape type 2
2026-03-30 09:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4ce8801b-c2cb-59b0-b239-45866c357ce8, identifier: EN15125
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_1d542cc74684109605f14fa06628b870.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_1d542cc74684109605f14fa06628b870.jpg not downloaded yet
2026-03-30 09:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_81895f4ffb7519ce2503bfd941e14a87.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:38 [auto1.it] INFO: Found listing with ID: EN03820
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN03820%27 HTTP/1.1" 200 None
2026-03-30 09:08:38 [auto1.it] INFO: Scrape type for EN03820: 2
2026-03-30 09:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16e46524-a03f-5fdc-98ac-83017852ca33 with identifier: EN03820
2026-03-30 09:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16e46524-a03f-5fdc-98ac-83017852ca33 with scrape type 2
2026-03-30 09:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16e46524-a03f-5fdc-98ac-83017852ca33 with scrape type 2
2026-03-30 09:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 16e46524-a03f-5fdc-98ac-83017852ca33, identifier: EN03820
2026-03-30 09:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4ce8801b-c2cb-59b0-b239-45866c357ce8 with identifier: EN15125
2026-03-30 09:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4ce8801b-c2cb-59b0-b239-45866c357ce8 with identifier: EN15125
2026-03-30 09:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4ce8801b-c2cb-59b0-b239-45866c357ce8 with identifier: EN15125 to the API
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:56:16Z',
 'fuel_type': 'diesel',
 'id': '4ce8801b-c2cb-59b0-b239-45866c357ce8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN15125',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 200585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-10',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN15125%27 HTTP/1.1" 200 None
2026-03-30 09:08:38 [auto1.it] INFO: Saving data for EN15125: {'auction_closing_time': 1774972576.0, 'created_time': 1774040800.633217, 'last_price_update_time': 1774861718.646669}
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN15125') HTTP/1.1" 204 0
2026-03-30 09:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1108b90>
2026-03-30 09:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_2cd59799ad2ab2fe56235b037d3833b0.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_2cd59799ad2ab2fe56235b037d3833b0.jpg saved to cache
2026-03-30 09:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d
2026-03-30 09:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 16e46524-a03f-5fdc-98ac-83017852ca33 with identifier: EN03820
2026-03-30 09:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 16e46524-a03f-5fdc-98ac-83017852ca33 with identifier: EN03820
2026-03-30 09:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 16e46524-a03f-5fdc-98ac-83017852ca33 with identifier: EN03820 to the API
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:35:57Z',
 'fuel_type': 'diesel',
 'id': '16e46524-a03f-5fdc-98ac-83017852ca33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN03820',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 127614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-25',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN03820%27 HTTP/1.1" 200 None
2026-03-30 09:08:39 [auto1.it] INFO: Saving data for EN03820: {'auction_closing_time': 1774971357.0, 'created_time': 1774386638.956248, 'last_price_update_time': 1774861719.280207}
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN03820') HTTP/1.1" 204 0
2026-03-30 09:08:39 [auto1.it] INFO: Found listing with ID: PD42328
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD42328%27 HTTP/1.1" 200 None
2026-03-30 09:08:39 [auto1.it] INFO: Scrape type for PD42328: 2
2026-03-30 09:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a908918-54d4-52a5-bb62-ca0e1c1734aa with identifier: PD42328
2026-03-30 09:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a908918-54d4-52a5-bb62-ca0e1c1734aa with scrape type 2
2026-03-30 09:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a908918-54d4-52a5-bb62-ca0e1c1734aa with scrape type 2
2026-03-30 09:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a908918-54d4-52a5-bb62-ca0e1c1734aa, identifier: PD42328
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_923432e969e5d00a3e3edb5bab09e20c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_923432e969e5d00a3e3edb5bab09e20c.jpg not downloaded yet
2026-03-30 09:08:39 [auto1.it] INFO: Found listing with ID: GW95975
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW95975%27 HTTP/1.1" 200 None
2026-03-30 09:08:39 [auto1.it] INFO: Scrape type for GW95975: 2
2026-03-30 09:08:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a229e3b8-8163-54ef-8516-574662e4435d with identifier: GW95975
2026-03-30 09:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a229e3b8-8163-54ef-8516-574662e4435d with scrape type 2
2026-03-30 09:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a229e3b8-8163-54ef-8516-574662e4435d with scrape type 2
2026-03-30 09:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a229e3b8-8163-54ef-8516-574662e4435d, identifier: GW95975
2026-03-30 09:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a908918-54d4-52a5-bb62-ca0e1c1734aa with identifier: PD42328
2026-03-30 09:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a908918-54d4-52a5-bb62-ca0e1c1734aa with identifier: PD42328
2026-03-30 09:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a908918-54d4-52a5-bb62-ca0e1c1734aa with identifier: PD42328 to the API
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:03:07Z',
 'fuel_type': 'petrol',
 'id': '7a908918-54d4-52a5-bb62-ca0e1c1734aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD42328',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 184261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-27',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Cosmo ecoFlex',
 'transmission': 'manual',
 'trim': 'Cosmo ecoFlex',
 'year': 2015}
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD42328%27 HTTP/1.1" 200 None
2026-03-30 09:08:39 [auto1.it] INFO: Saving data for PD42328: {'auction_closing_time': 1774969387.0, 'created_time': 1773328012.120623, 'last_price_update_time': 1774861719.977074}
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PD42328') HTTP/1.1" 204 0
2026-03-30 09:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fb8210>
2026-03-30 09:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_929e3550f7e8b2945426a54a99036642.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_929e3550f7e8b2945426a54a99036642.jpg saved to cache
2026-03-30 09:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d
2026-03-30 09:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7cf51822bf11aac276d9376c98156b54.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_7eb6e98f8455d0c76851d2303640febc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a229e3b8-8163-54ef-8516-574662e4435d with identifier: GW95975
2026-03-30 09:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a229e3b8-8163-54ef-8516-574662e4435d with identifier: GW95975
2026-03-30 09:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a229e3b8-8163-54ef-8516-574662e4435d with identifier: GW95975 to the API
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-31T15:37:26Z',
 'fuel_type': 'diesel',
 'id': 'a229e3b8-8163-54ef-8516-574662e4435d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW95975',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 159064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-23',
 'seller_name': None,
 'title': 'Land Rover Evoque D180 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW95975%27 HTTP/1.1" 200 None
2026-03-30 09:08:40 [auto1.it] INFO: Saving data for GW95975: {'auction_closing_time': 1774971446.0, 'created_time': 1772090410.510705, 'last_price_update_time': 1774861720.417901}
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GW95975') HTTP/1.1" 204 0
2026-03-30 09:08:40 [auto1.it] INFO: Found listing with ID: XT99009
2026-03-30 09:08:40 [auto1.it] INFO: Found listing with ID: KD47428
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD47428%27 HTTP/1.1" 200 None
2026-03-30 09:08:40 [auto1.it] INFO: Scrape type for KD47428: 2
2026-03-30 09:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c617282b-3c1f-5eab-98c9-d94c75e562df with identifier: KD47428
2026-03-30 09:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c617282b-3c1f-5eab-98c9-d94c75e562df with scrape type 2
2026-03-30 09:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c617282b-3c1f-5eab-98c9-d94c75e562df with scrape type 2
2026-03-30 09:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c617282b-3c1f-5eab-98c9-d94c75e562df, identifier: KD47428
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_fe3785d6f5c1ca350ad03845a3972473.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_fe3785d6f5c1ca350ad03845a3972473.jpg not downloaded yet
2026-03-30 09:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_665589895d0e6ba376654e5e9b8db372.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:40 [auto1.it] INFO: Found listing with ID: JE32624
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE32624%27 HTTP/1.1" 200 None
2026-03-30 09:08:40 [auto1.it] INFO: Scrape type for JE32624: 2
2026-03-30 09:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17cfb856-dd26-5b33-97bb-e5b108b53c62 with identifier: JE32624
2026-03-30 09:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17cfb856-dd26-5b33-97bb-e5b108b53c62 with scrape type 2
2026-03-30 09:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17cfb856-dd26-5b33-97bb-e5b108b53c62 with scrape type 2
2026-03-30 09:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17cfb856-dd26-5b33-97bb-e5b108b53c62, identifier: JE32624
2026-03-30 09:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c617282b-3c1f-5eab-98c9-d94c75e562df with identifier: KD47428
2026-03-30 09:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c617282b-3c1f-5eab-98c9-d94c75e562df with identifier: KD47428
2026-03-30 09:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c617282b-3c1f-5eab-98c9-d94c75e562df with identifier: KD47428 to the API
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:04:49Z',
 'fuel_type': 'diesel',
 'id': 'c617282b-3c1f-5eab-98c9-d94c75e562df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD47428',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 177476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-03',
 'seller_name': None,
 'title': 'Audi Q5 Sportback 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD47428%27 HTTP/1.1" 200 None
2026-03-30 09:08:41 [auto1.it] INFO: Saving data for KD47428: {'auction_closing_time': 1774969489.0, 'created_time': 1774472961.961247, 'last_price_update_time': 1774861721.057797}
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KD47428') HTTP/1.1" 204 0
2026-03-30 09:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG07362/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX71536> (referer: https://www.auto1.com/v1/car-details-view/SX71536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2505750>
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_81895f4ffb7519ce2503bfd941e14a87.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_81895f4ffb7519ce2503bfd941e14a87.jpg saved to cache
2026-03-30 09:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d
2026-03-30 09:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17cfb856-dd26-5b33-97bb-e5b108b53c62 with identifier: JE32624
2026-03-30 09:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17cfb856-dd26-5b33-97bb-e5b108b53c62 with identifier: JE32624
2026-03-30 09:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 17cfb856-dd26-5b33-97bb-e5b108b53c62 with identifier: JE32624 to the API
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:47:15Z',
 'fuel_type': 'diesel',
 'id': '17cfb856-dd26-5b33-97bb-e5b108b53c62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE32624',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 179909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-02',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Laureate Family 4x2',
 'transmission': 'manual',
 'trim': 'Laureate Family 4x2',
 'year': 2016}
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE32624%27 HTTP/1.1" 200 None
2026-03-30 09:08:41 [auto1.it] INFO: Saving data for JE32624: {'auction_closing_time': 1774972035.0, 'created_time': 1773267337.273631, 'last_price_update_time': 1774861721.477167}
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE32624') HTTP/1.1" 204 0
2026-03-30 09:08:41 [auto1.it] INFO: Found listing with ID: EW53472
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW53472%27 HTTP/1.1" 200 None
2026-03-30 09:08:41 [auto1.it] INFO: Scrape type for EW53472: 1
2026-03-30 09:08:41 [auto1.it] INFO: Found listing with ID: VJ49724
2026-03-30 09:08:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2576790>
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_7cf51822bf11aac276d9376c98156b54.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7cf51822bf11aac276d9376c98156b54.jpg saved to cache
2026-03-30 09:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7234cc4b-05e8-5a36-98cc-ecae825da1db
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1469c50>
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_7eb6e98f8455d0c76851d2303640febc.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_7eb6e98f8455d0c76851d2303640febc.jpg saved to cache
2026-03-30 09:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d
2026-03-30 09:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_1d542cc74684109605f14fa06628b870.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:41 [auto1.it] INFO: Found listing with ID: FB83790
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB83790%27 HTTP/1.1" 200 None
2026-03-30 09:08:41 [auto1.it] INFO: Scrape type for FB83790: 2
2026-03-30 09:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38bc702d-6651-5a0a-80b5-204947f9169c with identifier: FB83790
2026-03-30 09:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38bc702d-6651-5a0a-80b5-204947f9169c with scrape type 2
2026-03-30 09:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38bc702d-6651-5a0a-80b5-204947f9169c with scrape type 2
2026-03-30 09:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 38bc702d-6651-5a0a-80b5-204947f9169c, identifier: FB83790
2026-03-30 09:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH80469> (referer: https://www.auto1.com/v1/car-details-view/JH80469/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_923432e969e5d00a3e3edb5bab09e20c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 38bc702d-6651-5a0a-80b5-204947f9169c with identifier: FB83790
2026-03-30 09:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 38bc702d-6651-5a0a-80b5-204947f9169c with identifier: FB83790
2026-03-30 09:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 38bc702d-6651-5a0a-80b5-204947f9169c with identifier: FB83790 to the API
2026-03-30 09:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:19:12Z',
 'fuel_type': 'diesel',
 'id': '38bc702d-6651-5a0a-80b5-204947f9169c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB83790',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 423569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-24',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2008}
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB83790%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [auto1.it] INFO: Saving data for FB83790: {'auction_closing_time': 1774970352.0, 'created_time': 1772223181.807629, 'last_price_update_time': 1774861722.229706}
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FB83790') HTTP/1.1" 204 0
2026-03-30 09:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13a2190>
2026-03-30 09:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_665589895d0e6ba376654e5e9b8db372.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_665589895d0e6ba376654e5e9b8db372.jpg saved to cache
2026-03-30 09:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d
2026-03-30 09:08:42 [auto1.it] INFO: Channel: 24h | Page: 13 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b7ad6d0-a179-5410-985c-d85258b21310 with identifier: SX71536
2026-03-30 09:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b7ad6d0-a179-5410-985c-d85258b21310 with scrape type 1
2026-03-30 09:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_43377955fbb3e7ca0696618d850078c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_43377955fbb3e7ca0696618d850078c2.jpg not downloaded yet
2026-03-30 09:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_5529cfc5b231f8098d9eec748e2d0c31.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: HU20333
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: RA62003
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: KE18489
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE18489%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [auto1.it] INFO: Scrape type for KE18489: 2
2026-03-30 09:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb56491d-06cc-508f-a3e1-4f9fcdd5108b with identifier: KE18489
2026-03-30 09:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb56491d-06cc-508f-a3e1-4f9fcdd5108b with scrape type 2
2026-03-30 09:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb56491d-06cc-508f-a3e1-4f9fcdd5108b with scrape type 2
2026-03-30 09:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb56491d-06cc-508f-a3e1-4f9fcdd5108b, identifier: KE18489
2026-03-30 09:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb56491d-06cc-508f-a3e1-4f9fcdd5108b with identifier: KE18489
2026-03-30 09:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb56491d-06cc-508f-a3e1-4f9fcdd5108b with identifier: KE18489
2026-03-30 09:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb56491d-06cc-508f-a3e1-4f9fcdd5108b with identifier: KE18489 to the API
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:16:46Z',
 'fuel_type': 'hybrid',
 'id': 'fb56491d-06cc-508f-a3e1-4f9fcdd5108b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE18489',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 22407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active',
 'transmission': 'automatic',
 'trim': '2WD Active',
 'year': 2022}
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE18489%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [auto1.it] INFO: Saving data for KE18489: {'auction_closing_time': 1774970206.0, 'created_time': 1774440329.551399, 'last_price_update_time': 1774861722.833266}
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KE18489') HTTP/1.1" 204 0
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: VF12324
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: VG29105
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: EU76954
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: HE03479
2026-03-30 09:08:42 [auto1.it] INFO: Found listing with ID: WN10249
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN10249%27 HTTP/1.1" 200 None
2026-03-30 09:08:42 [auto1.it] INFO: Scrape type for WN10249: 2
2026-03-30 09:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f29ac06-8d26-51e0-9dd1-c86732d79f54 with identifier: WN10249
2026-03-30 09:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f29ac06-8d26-51e0-9dd1-c86732d79f54 with scrape type 2
2026-03-30 09:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f29ac06-8d26-51e0-9dd1-c86732d79f54 with scrape type 2
2026-03-30 09:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f29ac06-8d26-51e0-9dd1-c86732d79f54, identifier: WN10249
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_fd8b7d2ac97930233fb6a2ac09f7ca75.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_fd8b7d2ac97930233fb6a2ac09f7ca75.jpg not downloaded yet
2026-03-30 09:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7a34a9db9ef8b7c85ff54a2437695379.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_fe3785d6f5c1ca350ad03845a3972473.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:43 [auto1.it] INFO: Found listing with ID: PX43587
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX43587%27 HTTP/1.1" 200 None
2026-03-30 09:08:43 [auto1.it] INFO: Scrape type for PX43587: 2
2026-03-30 09:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28ddc463-4dd8-5629-ba0e-9bf99d4660c9 with identifier: PX43587
2026-03-30 09:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28ddc463-4dd8-5629-ba0e-9bf99d4660c9 with scrape type 2
2026-03-30 09:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28ddc463-4dd8-5629-ba0e-9bf99d4660c9 with scrape type 2
2026-03-30 09:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 28ddc463-4dd8-5629-ba0e-9bf99d4660c9, identifier: PX43587
2026-03-30 09:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f29ac06-8d26-51e0-9dd1-c86732d79f54 with identifier: WN10249
2026-03-30 09:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f29ac06-8d26-51e0-9dd1-c86732d79f54 with identifier: WN10249
2026-03-30 09:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f29ac06-8d26-51e0-9dd1-c86732d79f54 with identifier: WN10249 to the API
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:34:57Z',
 'fuel_type': 'diesel',
 'id': '9f29ac06-8d26-51e0-9dd1-c86732d79f54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN10249',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40 Cross Country',
 'odometer': 255169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Volvo V40 Cross Country 2.0 D2 Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN10249%27 HTTP/1.1" 200 None
2026-03-30 09:08:43 [auto1.it] INFO: Saving data for WN10249: {'auction_closing_time': 1774971297.0, 'created_time': 1773236643.130211, 'last_price_update_time': 1774861723.625557}
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WN10249') HTTP/1.1" 204 0
2026-03-30 09:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13763d0>
2026-03-30 09:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_1d542cc74684109605f14fa06628b870.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_1d542cc74684109605f14fa06628b870.jpg saved to cache
2026-03-30 09:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d
2026-03-30 09:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5659553-81a0-57f8-9108-7f9c78423028 with identifier: JH80469
2026-03-30 09:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5659553-81a0-57f8-9108-7f9c78423028 with scrape type 1
2026-03-30 09:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5659553-81a0-57f8-9108-7f9c78423028
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_55c6bb517bc8cac7da952ed31d4dddeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_55c6bb517bc8cac7da952ed31d4dddeb.jpg not downloaded yet
2026-03-30 09:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fa7b90>
2026-03-30 09:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_923432e969e5d00a3e3edb5bab09e20c.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_923432e969e5d00a3e3edb5bab09e20c.jpg saved to cache
2026-03-30 09:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d
2026-03-30 09:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 28ddc463-4dd8-5629-ba0e-9bf99d4660c9 with identifier: PX43587
2026-03-30 09:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 28ddc463-4dd8-5629-ba0e-9bf99d4660c9 with identifier: PX43587
2026-03-30 09:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 28ddc463-4dd8-5629-ba0e-9bf99d4660c9 with identifier: PX43587 to the API
2026-03-30 09:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 63,
 'expiration_date': '2026-03-31T15:30:59Z',
 'fuel_type': 'petrol',
 'id': '28ddc463-4dd8-5629-ba0e-9bf99d4660c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX43587',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 5266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-10',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Connectline',
 'transmission': 'automatic',
 'trim': 'Connectline',
 'year': 2024}
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX43587%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Saving data for PX43587: {'auction_closing_time': 1774971059.0, 'created_time': 1774447530.382923, 'last_price_update_time': 1774861724.15789}
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PX43587') HTTP/1.1" 204 0
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: VC96315
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: DG11990
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG11990%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Scrape type for DG11990: 2
2026-03-30 09:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bff4710a-2633-5c3e-9e8b-22427d6fe97a with identifier: DG11990
2026-03-30 09:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bff4710a-2633-5c3e-9e8b-22427d6fe97a with scrape type 2
2026-03-30 09:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bff4710a-2633-5c3e-9e8b-22427d6fe97a with scrape type 2
2026-03-30 09:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bff4710a-2633-5c3e-9e8b-22427d6fe97a, identifier: DG11990
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_7a7e019ae5eaea991df2a129126cbc81.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_7a7e019ae5eaea991df2a129126cbc81.jpg not downloaded yet
2026-03-30 09:08:44 [auto1.it] INFO: Found listing with ID: CE26038
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE26038%27 HTTP/1.1" 200 None
2026-03-30 09:08:44 [auto1.it] INFO: Scrape type for CE26038: 2
2026-03-30 09:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b082ba23-42ba-5d1c-b6e7-5881034554e0 with identifier: CE26038
2026-03-30 09:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b082ba23-42ba-5d1c-b6e7-5881034554e0 with scrape type 2
2026-03-30 09:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b082ba23-42ba-5d1c-b6e7-5881034554e0 with scrape type 2
2026-03-30 09:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b082ba23-42ba-5d1c-b6e7-5881034554e0, identifier: CE26038
2026-03-30 09:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bff4710a-2633-5c3e-9e8b-22427d6fe97a with identifier: DG11990
2026-03-30 09:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bff4710a-2633-5c3e-9e8b-22427d6fe97a with identifier: DG11990
2026-03-30 09:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bff4710a-2633-5c3e-9e8b-22427d6fe97a with identifier: DG11990 to the API
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:55:50Z',
 'fuel_type': 'diesel',
 'id': 'bff4710a-2633-5c3e-9e8b-22427d6fe97a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG11990',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Alfa 156',
 'odometer': 261887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-25',
 'seller_name': None,
 'title': 'Alfa Romeo Alfa 156 1.9 JTD Progression',
 'transmission': 'manual',
 'trim': 'Progression',
 'year': 2003}
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG11990%27 HTTP/1.1" 200 None
2026-03-30 09:08:45 [auto1.it] INFO: Saving data for DG11990: {'auction_closing_time': 1774972550.0, 'created_time': 1774386448.772942, 'last_price_update_time': 1774861725.131994}
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DG11990') HTTP/1.1" 204 0
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_5711a308d834e04289735de2159f67fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_5711a308d834e04289735de2159f67fc.jpg not downloaded yet
2026-03-30 09:08:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fe8e10>
2026-03-30 09:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_5529cfc5b231f8098d9eec748e2d0c31.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_5529cfc5b231f8098d9eec748e2d0c31.jpg saved to cache
2026-03-30 09:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7234cc4b-05e8-5a36-98cc-ecae825da1db
2026-03-30 09:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b082ba23-42ba-5d1c-b6e7-5881034554e0 with identifier: CE26038
2026-03-30 09:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b082ba23-42ba-5d1c-b6e7-5881034554e0 with identifier: CE26038
2026-03-30 09:08:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b082ba23-42ba-5d1c-b6e7-5881034554e0 with identifier: CE26038 to the API
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:44:13Z',
 'fuel_type': 'diesel',
 'id': 'b082ba23-42ba-5d1c-b6e7-5881034554e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE26038',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 156246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-10',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE26038%27 HTTP/1.1" 200 None
2026-03-30 09:08:45 [auto1.it] INFO: Saving data for CE26038: {'auction_closing_time': 1774971853.0, 'created_time': 1774440425.354173, 'last_price_update_time': 1774861725.648637}
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CE26038') HTTP/1.1" 204 0
2026-03-30 09:08:45 [auto1.it] INFO: Found listing with ID: VW71649
2026-03-30 09:08:45 [auto1.it] INFO: Found listing with ID: FC87594
2026-03-30 09:08:45 [auto1.it] INFO: Found listing with ID: AD85464
2026-03-30 09:08:45 [auto1.it] INFO: Found listing with ID: SP63067
2026-03-30 09:08:45 [auto1.it] INFO: Found listing with ID: YW84907
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW84907%27 HTTP/1.1" 200 None
2026-03-30 09:08:45 [auto1.it] INFO: Scrape type for YW84907: 2
2026-03-30 09:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1b95a39-6417-542f-972d-6b66048577b5 with identifier: YW84907
2026-03-30 09:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1b95a39-6417-542f-972d-6b66048577b5 with scrape type 2
2026-03-30 09:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1b95a39-6417-542f-972d-6b66048577b5 with scrape type 2
2026-03-30 09:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1b95a39-6417-542f-972d-6b66048577b5, identifier: YW84907
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_67c6dfe42b3d913f8417eb988dfcf147.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_67c6dfe42b3d913f8417eb988dfcf147.jpg not downloaded yet
2026-03-30 09:08:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2547210>
2026-03-30 09:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F82%252F7982db81efe0a02fe78afd742e631bba%252Fpa%252FGN01544_7a34a9db9ef8b7c85ff54a2437695379.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7a34a9db9ef8b7c85ff54a2437695379.jpg saved to cache
2026-03-30 09:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7234cc4b-05e8-5a36-98cc-ecae825da1db
2026-03-30 09:08:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7234cc4b-05e8-5a36-98cc-ecae825da1db, skipping ID generation
2026-03-30 09:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7234cc4b-05e8-5a36-98cc-ecae825da1db with scrape type 1
2026-03-30 09:08:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7234cc4b-05e8-5a36-98cc-ecae825da1db sending to next pipeline
2026-03-30 09:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7234cc4b-05e8-5a36-98cc-ecae825da1db, identifier: GN01544
2026-03-30 09:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1104690>
2026-03-30 09:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fe2%252Fc8e2ae922dd697ea3affd02f78d8219a%252Fpa%252FVR96583_fe3785d6f5c1ca350ad03845a3972473.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_fe3785d6f5c1ca350ad03845a3972473.jpg saved to cache
2026-03-30 09:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d
2026-03-30 09:08:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18bb6a2c-a034-5ce2-91fc-f8923807dd0d, skipping ID generation
2026-03-30 09:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d with scrape type 1
2026-03-30 09:08:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18bb6a2c-a034-5ce2-91fc-f8923807dd0d sending to next pipeline
2026-03-30 09:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18bb6a2c-a034-5ce2-91fc-f8923807dd0d, identifier: VR96583
2026-03-30 09:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_43377955fbb3e7ca0696618d850078c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: JR23231
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: ZG72619
2026-03-30 09:08:46 [auto1.it] INFO: Found listing with ID: UX25777
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX25777%27 HTTP/1.1" 200 None
2026-03-30 09:08:46 [auto1.it] INFO: Scrape type for UX25777: 2
2026-03-30 09:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4683d93-e070-5f34-b4ab-3691051de1ce with identifier: UX25777
2026-03-30 09:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4683d93-e070-5f34-b4ab-3691051de1ce with scrape type 2
2026-03-30 09:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4683d93-e070-5f34-b4ab-3691051de1ce with scrape type 2
2026-03-30 09:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4683d93-e070-5f34-b4ab-3691051de1ce, identifier: UX25777
2026-03-30 09:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1b95a39-6417-542f-972d-6b66048577b5 with identifier: YW84907
2026-03-30 09:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1b95a39-6417-542f-972d-6b66048577b5 with identifier: YW84907
2026-03-30 09:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1b95a39-6417-542f-972d-6b66048577b5 with identifier: YW84907 to the API
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-31T15:28:14Z',
 'fuel_type': 'petrol',
 'id': 'f1b95a39-6417-542f-972d-6b66048577b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW84907',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 13859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-12',
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid Pandina Cross',
 'transmission': 'manual',
 'trim': 'Pandina Cross',
 'year': 2025}
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW84907%27 HTTP/1.1" 200 None
2026-03-30 09:08:46 [auto1.it] INFO: Saving data for YW84907: {'auction_closing_time': 1774970894.0, 'created_time': 1774447555.911161, 'last_price_update_time': 1774861726.80095}
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YW84907') HTTP/1.1" 204 0
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_9b4572e7a6ecc038b855d18156f422bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_9b4572e7a6ecc038b855d18156f422bc.jpg not downloaded yet
2026-03-30 09:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7234cc4b-05e8-5a36-98cc-ecae825da1db with identifier: GN01544
2026-03-30 09:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7234cc4b-05e8-5a36-98cc-ecae825da1db with identifier: GN01544
2026-03-30 09:08:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7234cc4b-05e8-5a36-98cc-ecae825da1db with identifier: GN01544 to the API
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7a34a9db9ef8b7c85ff54a2437695379.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:43:11Z',
 'fuel_type': 'petrol',
 'id': '7234cc4b-05e8-5a36-98cc-ecae825da1db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN01544',
 'listing': 'auction',
 'location': 'IT, Corigliano-Rossano',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 69394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_d4ba56fa55f9dba609ef931ce5534592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2090849,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7cf51822bf11aac276d9376c98156b54.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_b8550a85a66fa8659a756e606487d0bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2261636,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7a34a9db9ef8b7c85ff54a2437695379.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2033804,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_5529cfc5b231f8098d9eec748e2d0c31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_e7a167fa37cb6183427f90c1f52d4dea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_22fd96aba9d08d71c5d073d02846f850.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_a263865ce47f62d698f60f02a197a62b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_a5018c386d351ebed42390c073c968d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7234cc4b-05e8-5a36-98cc-ecae825da1db/7234cc4b-05e8-5a36-98cc-ecae825da1db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/82/7982db81efe0a02fe78afd742e631bba/pa/GN01544_7c1dda8a7285d20051356657f8da601c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN01544%27 HTTP/1.1" 200 None
2026-03-30 09:08:47 [auto1.it] INFO: Saving data for GN01544: {'created_time': 1774861727.438718, 'last_price_update_time': 1774861727.438809, 'auction_closing_time': 1774971791.0}
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GN01544') HTTP/1.1" 204 0
2026-03-30 09:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18bb6a2c-a034-5ce2-91fc-f8923807dd0d with identifier: VR96583
2026-03-30 09:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18bb6a2c-a034-5ce2-91fc-f8923807dd0d with identifier: VR96583
2026-03-30 09:08:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18bb6a2c-a034-5ce2-91fc-f8923807dd0d with identifier: VR96583 to the API
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_fe3785d6f5c1ca350ad03845a3972473.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:43:17Z',
 'fuel_type': 'petrol',
 'id': '18bb6a2c-a034-5ce2-91fc-f8923807dd0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR96583',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 121676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_d7ddb3b2946343d3517b65a9ab17e610.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_b891e7da162cb83915fb7ab3c3355bc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_2cd59799ad2ab2fe56235b037d3833b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_929e3550f7e8b2945426a54a99036642.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_81895f4ffb7519ce2503bfd941e14a87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_7eb6e98f8455d0c76851d2303640febc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_665589895d0e6ba376654e5e9b8db372.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_1d542cc74684109605f14fa06628b870.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_923432e969e5d00a3e3edb5bab09e20c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18bb6a2c-a034-5ce2-91fc-f8923807dd0d/18bb6a2c-a034-5ce2-91fc-f8923807dd0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/e2/c8e2ae922dd697ea3affd02f78d8219a/pa/VR96583_fe3785d6f5c1ca350ad03845a3972473.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2017}
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR96583%27 HTTP/1.1" 200 None
2026-03-30 09:08:47 [auto1.it] INFO: Saving data for VR96583: {'created_time': 1774861727.872573, 'last_price_update_time': 1774861727.872584, 'auction_closing_time': 1774971797.0}
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VR96583') HTTP/1.1" 204 0
2026-03-30 09:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_fd8b7d2ac97930233fb6a2ac09f7ca75.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4683d93-e070-5f34-b4ab-3691051de1ce with identifier: UX25777
2026-03-30 09:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4683d93-e070-5f34-b4ab-3691051de1ce with identifier: UX25777
2026-03-30 09:08:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4683d93-e070-5f34-b4ab-3691051de1ce with identifier: UX25777 to the API
2026-03-30 09:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:50:35Z',
 'fuel_type': 'petrol',
 'id': 'a4683d93-e070-5f34-b4ab-3691051de1ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX25777',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 127501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-30',
 'seller_name': None,
 'title': 'Honda Civic 1.4 Type S',
 'transmission': 'manual',
 'trim': 'Type S',
 'year': 2010}
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX25777%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Saving data for UX25777: {'auction_closing_time': 1774972235.0, 'created_time': 1774015965.591983, 'last_price_update_time': 1774861728.230826}
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UX25777') HTTP/1.1" 204 0
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: JH15669
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: YZ52135
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: ZM37074
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM37074%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Scrape type for ZM37074: 2
2026-03-30 09:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57fd59d4-95ce-5576-bfad-ddae572ef585 with identifier: ZM37074
2026-03-30 09:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57fd59d4-95ce-5576-bfad-ddae572ef585 with scrape type 2
2026-03-30 09:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57fd59d4-95ce-5576-bfad-ddae572ef585 with scrape type 2
2026-03-30 09:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57fd59d4-95ce-5576-bfad-ddae572ef585, identifier: ZM37074
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_86514e277eef9dc106c6cc3138bfff7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_86514e277eef9dc106c6cc3138bfff7d.jpg not downloaded yet
2026-03-30 09:08:48 [auto1.it] INFO: Found listing with ID: JJ67638
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ67638%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Scrape type for JJ67638: 2
2026-03-30 09:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cbf286a-db2e-538f-8470-f2ed60882a5a with identifier: JJ67638
2026-03-30 09:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cbf286a-db2e-538f-8470-f2ed60882a5a with scrape type 2
2026-03-30 09:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cbf286a-db2e-538f-8470-f2ed60882a5a with scrape type 2
2026-03-30 09:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6cbf286a-db2e-538f-8470-f2ed60882a5a, identifier: JJ67638
2026-03-30 09:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57fd59d4-95ce-5576-bfad-ddae572ef585 with identifier: ZM37074
2026-03-30 09:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57fd59d4-95ce-5576-bfad-ddae572ef585 with identifier: ZM37074
2026-03-30 09:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57fd59d4-95ce-5576-bfad-ddae572ef585 with identifier: ZM37074 to the API
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:55:53Z',
 'fuel_type': 'diesel',
 'id': '57fd59d4-95ce-5576-bfad-ddae572ef585',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM37074',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 182770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-22',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM37074%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [auto1.it] INFO: Saving data for ZM37074: {'auction_closing_time': 1774972553.0, 'created_time': 1773231405.151091, 'last_price_update_time': 1774861728.878431}
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZM37074') HTTP/1.1" 204 0
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_7dbd9e41f92ce8730be78d7b360b3405.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_7dbd9e41f92ce8730be78d7b360b3405.jpg not downloaded yet
2026-03-30 09:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW53472/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6cbf286a-db2e-538f-8470-f2ed60882a5a with identifier: JJ67638
2026-03-30 09:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6cbf286a-db2e-538f-8470-f2ed60882a5a with identifier: JJ67638
2026-03-30 09:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6cbf286a-db2e-538f-8470-f2ed60882a5a with identifier: JJ67638 to the API
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:54:26Z',
 'fuel_type': 'diesel',
 'id': '6cbf286a-db2e-538f-8470-f2ed60882a5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ67638',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 96777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-12',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ67638%27 HTTP/1.1" 200 None
2026-03-30 09:08:49 [auto1.it] INFO: Saving data for JJ67638: {'auction_closing_time': 1774972466.0, 'created_time': 1773522345.923445, 'last_price_update_time': 1774861729.245017}
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JJ67638') HTTP/1.1" 204 0
2026-03-30 09:08:49 [auto1.it] INFO: Found listing with ID: RT96174
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT96174%27 HTTP/1.1" 200 None
2026-03-30 09:08:49 [auto1.it] INFO: Scrape type for RT96174: 2
2026-03-30 09:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab7aa8b-26fc-56d4-aa62-d690269585fe with identifier: RT96174
2026-03-30 09:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab7aa8b-26fc-56d4-aa62-d690269585fe with scrape type 2
2026-03-30 09:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ab7aa8b-26fc-56d4-aa62-d690269585fe with scrape type 2
2026-03-30 09:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ab7aa8b-26fc-56d4-aa62-d690269585fe, identifier: RT96174
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_6252f5722555e4b943bd6c09170ece23.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_6252f5722555e4b943bd6c09170ece23.jpg not downloaded yet
2026-03-30 09:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2776550>
2026-03-30 09:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_43377955fbb3e7ca0696618d850078c2.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_43377955fbb3e7ca0696618d850078c2.jpg saved to cache
2026-03-30 09:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-03-30 09:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_55c6bb517bc8cac7da952ed31d4dddeb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_7a7e019ae5eaea991df2a129126cbc81.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:49 [auto1.it] INFO: Found listing with ID: GT84343
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT84343%27 HTTP/1.1" 200 None
2026-03-30 09:08:49 [auto1.it] INFO: Scrape type for GT84343: 2
2026-03-30 09:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f288219-dbbe-5010-b5f4-3c0e387f39ff with identifier: GT84343
2026-03-30 09:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f288219-dbbe-5010-b5f4-3c0e387f39ff with scrape type 2
2026-03-30 09:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f288219-dbbe-5010-b5f4-3c0e387f39ff with scrape type 2
2026-03-30 09:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f288219-dbbe-5010-b5f4-3c0e387f39ff, identifier: GT84343
2026-03-30 09:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ab7aa8b-26fc-56d4-aa62-d690269585fe with identifier: RT96174
2026-03-30 09:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ab7aa8b-26fc-56d4-aa62-d690269585fe with identifier: RT96174
2026-03-30 09:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ab7aa8b-26fc-56d4-aa62-d690269585fe with identifier: RT96174 to the API
2026-03-30 09:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:38:33Z',
 'fuel_type': 'diesel',
 'id': '8ab7aa8b-26fc-56d4-aa62-d690269585fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT96174',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 97912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2017}
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT96174%27 HTTP/1.1" 200 None
2026-03-30 09:08:50 [auto1.it] INFO: Saving data for RT96174: {'auction_closing_time': 1774971513.0, 'created_time': 1773936523.381385, 'last_price_update_time': 1774861730.238735}
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT96174') HTTP/1.1" 204 0
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_bcb50f43528b693f23ef4df6b8791026.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_bcb50f43528b693f23ef4df6b8791026.jpg not downloaded yet
2026-03-30 09:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee285c190>
2026-03-30 09:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_fd8b7d2ac97930233fb6a2ac09f7ca75.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_fd8b7d2ac97930233fb6a2ac09f7ca75.jpg saved to cache
2026-03-30 09:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-03-30 09:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f288219-dbbe-5010-b5f4-3c0e387f39ff with identifier: GT84343
2026-03-30 09:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f288219-dbbe-5010-b5f4-3c0e387f39ff with identifier: GT84343
2026-03-30 09:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f288219-dbbe-5010-b5f4-3c0e387f39ff with identifier: GT84343 to the API
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:08:40Z',
 'fuel_type': 'petrol',
 'id': '2f288219-dbbe-5010-b5f4-3c0e387f39ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT84343',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 95542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-25',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT84343%27 HTTP/1.1" 200 None
2026-03-30 09:08:50 [auto1.it] INFO: Saving data for GT84343: {'auction_closing_time': 1774969720.0, 'created_time': 1774472816.495459, 'last_price_update_time': 1774861730.691855}
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT84343') HTTP/1.1" 204 0
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: XU27614
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: TN93394
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN93394%27 HTTP/1.1" 200 None
2026-03-30 09:08:50 [auto1.it] INFO: Scrape type for TN93394: 2
2026-03-30 09:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb327f91-8427-504c-ab8a-c926341be169 with identifier: TN93394
2026-03-30 09:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb327f91-8427-504c-ab8a-c926341be169 with scrape type 2
2026-03-30 09:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb327f91-8427-504c-ab8a-c926341be169 with scrape type 2
2026-03-30 09:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb327f91-8427-504c-ab8a-c926341be169, identifier: TN93394
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_15c88d53f7a1555ba55cb4571b0c365e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_15c88d53f7a1555ba55cb4571b0c365e.jpg not downloaded yet
2026-03-30 09:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_5711a308d834e04289735de2159f67fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:50 [auto1.it] INFO: Found listing with ID: HH27298
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH27298%27 HTTP/1.1" 200 None
2026-03-30 09:08:50 [auto1.it] INFO: Scrape type for HH27298: 2
2026-03-30 09:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb45ecbb-5dcf-556e-b109-e916406be649 with identifier: HH27298
2026-03-30 09:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb45ecbb-5dcf-556e-b109-e916406be649 with scrape type 2
2026-03-30 09:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb45ecbb-5dcf-556e-b109-e916406be649 with scrape type 2
2026-03-30 09:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb45ecbb-5dcf-556e-b109-e916406be649, identifier: HH27298
2026-03-30 09:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb327f91-8427-504c-ab8a-c926341be169 with identifier: TN93394
2026-03-30 09:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb327f91-8427-504c-ab8a-c926341be169 with identifier: TN93394
2026-03-30 09:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb327f91-8427-504c-ab8a-c926341be169 with identifier: TN93394 to the API
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:36:06Z',
 'fuel_type': 'diesel',
 'id': 'fb327f91-8427-504c-ab8a-c926341be169',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN93394',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 80598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-26',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exceed 4WD',
 'transmission': 'automatic',
 'trim': 'Exceed 4WD',
 'year': 2012}
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN93394%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [auto1.it] INFO: Saving data for TN93394: {'auction_closing_time': 1774971366.0, 'created_time': 1774386348.975274, 'last_price_update_time': 1774861731.34636}
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TN93394') HTTP/1.1" 204 0
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_4ea70924e065a63b06b747a7f8425e79.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_4ea70924e065a63b06b747a7f8425e79.jpg not downloaded yet
2026-03-30 09:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_9b4572e7a6ecc038b855d18156f422bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_86514e277eef9dc106c6cc3138bfff7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb45ecbb-5dcf-556e-b109-e916406be649 with identifier: HH27298
2026-03-30 09:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb45ecbb-5dcf-556e-b109-e916406be649 with identifier: HH27298
2026-03-30 09:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb45ecbb-5dcf-556e-b109-e916406be649 with identifier: HH27298 to the API
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:18:35Z',
 'fuel_type': 'petrol',
 'id': 'cb45ecbb-5dcf-556e-b109-e916406be649',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH27298',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 15461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-14',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 1.5 T-MIVEC Intense 4WD',
 'transmission': 'automatic',
 'trim': 'Intense 4WD',
 'year': 2020}
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH27298%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [auto1.it] INFO: Saving data for HH27298: {'auction_closing_time': 1774970315.0, 'created_time': 1774040850.503191, 'last_price_update_time': 1774861731.838763}
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HH27298') HTTP/1.1" 204 0
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: KT64374
2026-03-30 09:08:51 [auto1.it] INFO: Found listing with ID: SN21626
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN21626%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [auto1.it] INFO: Scrape type for SN21626: 2
2026-03-30 09:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e656b3bc-5327-574d-807f-63c3edd3504e with identifier: SN21626
2026-03-30 09:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e656b3bc-5327-574d-807f-63c3edd3504e with scrape type 2
2026-03-30 09:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e656b3bc-5327-574d-807f-63c3edd3504e with scrape type 2
2026-03-30 09:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e656b3bc-5327-574d-807f-63c3edd3504e, identifier: SN21626
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_9ff9fa67d7d3c368792927de48fc209b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_9ff9fa67d7d3c368792927de48fc209b.jpg not downloaded yet
2026-03-30 09:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2500810>
2026-03-30 09:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_55c6bb517bc8cac7da952ed31d4dddeb.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_55c6bb517bc8cac7da952ed31d4dddeb.jpg saved to cache
2026-03-30 09:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5659553-81a0-57f8-9108-7f9c78423028
2026-03-30 09:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee258b7d0>
2026-03-30 09:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_7a7e019ae5eaea991df2a129126cbc81.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_7a7e019ae5eaea991df2a129126cbc81.jpg saved to cache
2026-03-30 09:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: GY59997
2026-03-30 09:08:52 [auto1.it] INFO: Found listing with ID: JG07033
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG07033%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Scrape type for JG07033: 2
2026-03-30 09:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdde98be-dc01-56c5-b57e-dd665d86be1d with identifier: JG07033
2026-03-30 09:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdde98be-dc01-56c5-b57e-dd665d86be1d with scrape type 2
2026-03-30 09:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdde98be-dc01-56c5-b57e-dd665d86be1d with scrape type 2
2026-03-30 09:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bdde98be-dc01-56c5-b57e-dd665d86be1d, identifier: JG07033
2026-03-30 09:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e656b3bc-5327-574d-807f-63c3edd3504e with identifier: SN21626
2026-03-30 09:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e656b3bc-5327-574d-807f-63c3edd3504e with identifier: SN21626
2026-03-30 09:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e656b3bc-5327-574d-807f-63c3edd3504e with identifier: SN21626 to the API
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:53:55Z',
 'fuel_type': 'petrol',
 'id': 'e656b3bc-5327-574d-807f-63c3edd3504e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN21626',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 188748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN21626%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [auto1.it] INFO: Saving data for SN21626: {'auction_closing_time': 1774972435.0, 'created_time': 1774386324.156559, 'last_price_update_time': 1774861732.570308}
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN21626') HTTP/1.1" 204 0
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_381ab0f6074ae63bf8a8b1b92af94085.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_381ab0f6074ae63bf8a8b1b92af94085.jpg not downloaded yet
2026-03-30 09:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_7dbd9e41f92ce8730be78d7b360b3405.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bdde98be-dc01-56c5-b57e-dd665d86be1d with identifier: JG07033
2026-03-30 09:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bdde98be-dc01-56c5-b57e-dd665d86be1d with identifier: JG07033
2026-03-30 09:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bdde98be-dc01-56c5-b57e-dd665d86be1d with identifier: JG07033 to the API
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:51:28Z',
 'fuel_type': 'diesel',
 'id': 'bdde98be-dc01-56c5-b57e-dd665d86be1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG07033',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 247270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG07033%27 HTTP/1.1" 200 None
2026-03-30 09:08:53 [auto1.it] INFO: Saving data for JG07033: {'auction_closing_time': 1774972288.0, 'created_time': 1773500816.30715, 'last_price_update_time': 1774861733.06529}
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JG07033') HTTP/1.1" 204 0
2026-03-30 09:08:53 [auto1.it] INFO: Found listing with ID: SJ75121
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ75121%27 HTTP/1.1" 200 None
2026-03-30 09:08:53 [auto1.it] INFO: Scrape type for SJ75121: 2
2026-03-30 09:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4e3e71-228f-5e8b-889b-dee73738a20d with identifier: SJ75121
2026-03-30 09:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4e3e71-228f-5e8b-889b-dee73738a20d with scrape type 2
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b4e3e71-228f-5e8b-889b-dee73738a20d with scrape type 2
2026-03-30 09:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b4e3e71-228f-5e8b-889b-dee73738a20d, identifier: SJ75121
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_aede7d67c1f09ef31361085f0209ccd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_aede7d67c1f09ef31361085f0209ccd9.jpg not downloaded yet
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee146a490>
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_5711a308d834e04289735de2159f67fc.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_5711a308d834e04289735de2159f67fc.jpg saved to cache
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5659553-81a0-57f8-9108-7f9c78423028
2026-03-30 09:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_6252f5722555e4b943bd6c09170ece23.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:53 [auto1.it] INFO: Found listing with ID: LR66295
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR66295%27 HTTP/1.1" 200 None
2026-03-30 09:08:53 [auto1.it] INFO: Scrape type for LR66295: 2
2026-03-30 09:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee5095a5-9e43-59bc-a01b-b7b4281ce30c with identifier: LR66295
2026-03-30 09:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee5095a5-9e43-59bc-a01b-b7b4281ce30c with scrape type 2
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee5095a5-9e43-59bc-a01b-b7b4281ce30c with scrape type 2
2026-03-30 09:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee5095a5-9e43-59bc-a01b-b7b4281ce30c, identifier: LR66295
2026-03-30 09:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b4e3e71-228f-5e8b-889b-dee73738a20d with identifier: SJ75121
2026-03-30 09:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b4e3e71-228f-5e8b-889b-dee73738a20d with identifier: SJ75121
2026-03-30 09:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b4e3e71-228f-5e8b-889b-dee73738a20d with identifier: SJ75121 to the API
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:50:47Z',
 'fuel_type': 'petrol',
 'id': '3b4e3e71-228f-5e8b-889b-dee73738a20d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ75121',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 44008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-06',
 'seller_name': None,
 'title': 'BMW 3er 330i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2021}
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ75121%27 HTTP/1.1" 200 None
2026-03-30 09:08:53 [auto1.it] INFO: Saving data for SJ75121: {'auction_closing_time': 1774972247.0, 'created_time': 1774008324.667941, 'last_price_update_time': 1774861733.791188}
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SJ75121') HTTP/1.1" 204 0
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_892bc44e690190461fdfa589a5a0b1bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_892bc44e690190461fdfa589a5a0b1bc.jpg not downloaded yet
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2506d10>
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_9b4572e7a6ecc038b855d18156f422bc.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_9b4572e7a6ecc038b855d18156f422bc.jpg saved to cache
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5659553-81a0-57f8-9108-7f9c78423028
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1293050>
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_86514e277eef9dc106c6cc3138bfff7d.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_86514e277eef9dc106c6cc3138bfff7d.jpg saved to cache
2026-03-30 09:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-03-30 09:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_15c88d53f7a1555ba55cb4571b0c365e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee5095a5-9e43-59bc-a01b-b7b4281ce30c with identifier: LR66295
2026-03-30 09:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee5095a5-9e43-59bc-a01b-b7b4281ce30c with identifier: LR66295
2026-03-30 09:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee5095a5-9e43-59bc-a01b-b7b4281ce30c with identifier: LR66295 to the API
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:51:16Z',
 'fuel_type': 'diesel',
 'id': 'ee5095a5-9e43-59bc-a01b-b7b4281ce30c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR66295',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 274713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-16',
 'seller_name': None,
 'title': 'Kia Stonic 1.6 CRDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR66295%27 HTTP/1.1" 200 None
2026-03-30 09:08:54 [auto1.it] INFO: Saving data for LR66295: {'auction_closing_time': 1774972276.0, 'created_time': 1774386330.20877, 'last_price_update_time': 1774861734.307129}
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR66295') HTTP/1.1" 204 0
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: PP13796
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP13796%27 HTTP/1.1" 200 None
2026-03-30 09:08:54 [auto1.it] INFO: Scrape type for PP13796: 2
2026-03-30 09:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c140e01-5984-57ce-b722-d4e9fc015eaa with identifier: PP13796
2026-03-30 09:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c140e01-5984-57ce-b722-d4e9fc015eaa with scrape type 2
2026-03-30 09:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c140e01-5984-57ce-b722-d4e9fc015eaa with scrape type 2
2026-03-30 09:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c140e01-5984-57ce-b722-d4e9fc015eaa, identifier: PP13796
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_cc4eb042c61fd15a4f4b69c8885470e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_cc4eb042c61fd15a4f4b69c8885470e9.jpg not downloaded yet
2026-03-30 09:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_bcb50f43528b693f23ef4df6b8791026.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:54 [auto1.it] INFO: Found listing with ID: PF84937
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF84937%27 HTTP/1.1" 200 None
2026-03-30 09:08:54 [auto1.it] INFO: Scrape type for PF84937: 2
2026-03-30 09:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 028b34d3-ea91-51d8-af56-6fa1b210afae with identifier: PF84937
2026-03-30 09:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 028b34d3-ea91-51d8-af56-6fa1b210afae with scrape type 2
2026-03-30 09:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 028b34d3-ea91-51d8-af56-6fa1b210afae with scrape type 2
2026-03-30 09:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 028b34d3-ea91-51d8-af56-6fa1b210afae, identifier: PF84937
2026-03-30 09:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c140e01-5984-57ce-b722-d4e9fc015eaa with identifier: PP13796
2026-03-30 09:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c140e01-5984-57ce-b722-d4e9fc015eaa with identifier: PP13796
2026-03-30 09:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c140e01-5984-57ce-b722-d4e9fc015eaa with identifier: PP13796 to the API
2026-03-30 09:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:56:25Z',
 'fuel_type': 'petrol',
 'id': '2c140e01-5984-57ce-b722-d4e9fc015eaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP13796',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 58825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-27',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 GLTop',
 'transmission': 'automatic',
 'trim': 'GLTop',
 'year': 2012}
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP13796%27 HTTP/1.1" 200 None
2026-03-30 09:08:55 [auto1.it] INFO: Saving data for PP13796: {'auction_closing_time': 1774972585.0, 'created_time': 1774447551.523266, 'last_price_update_time': 1774861735.455381}
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PP13796') HTTP/1.1" 204 0
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_2caeadc2f981951289b0e995cb9dc40a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_2caeadc2f981951289b0e995cb9dc40a.jpg not downloaded yet
2026-03-30 09:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee258c690>
2026-03-30 09:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_7dbd9e41f92ce8730be78d7b360b3405.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_7dbd9e41f92ce8730be78d7b360b3405.jpg saved to cache
2026-03-30 09:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5659553-81a0-57f8-9108-7f9c78423028
2026-03-30 09:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_9ff9fa67d7d3c368792927de48fc209b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 028b34d3-ea91-51d8-af56-6fa1b210afae with identifier: PF84937
2026-03-30 09:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 028b34d3-ea91-51d8-af56-6fa1b210afae with identifier: PF84937
2026-03-30 09:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 028b34d3-ea91-51d8-af56-6fa1b210afae with identifier: PF84937 to the API
2026-03-30 09:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:04:04Z',
 'fuel_type': 'diesel',
 'id': '028b34d3-ea91-51d8-af56-6fa1b210afae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF84937',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 156295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-27',
 'seller_name': None,
 'title': 'Volvo S60 2.0 D4 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2011}
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF84937%27 HTTP/1.1" 200 None
2026-03-30 09:08:56 [auto1.it] INFO: Saving data for PF84937: {'auction_closing_time': 1774969444.0, 'created_time': 1774447559.955522, 'last_price_update_time': 1774861736.346175}
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PF84937') HTTP/1.1" 204 0
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: YM04442
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM04442%27 HTTP/1.1" 200 None
2026-03-30 09:08:56 [auto1.it] INFO: Scrape type for YM04442: 2
2026-03-30 09:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d867dd8-78a6-5abc-a504-729d7225ccc2 with identifier: YM04442
2026-03-30 09:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d867dd8-78a6-5abc-a504-729d7225ccc2 with scrape type 2
2026-03-30 09:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d867dd8-78a6-5abc-a504-729d7225ccc2 with scrape type 2
2026-03-30 09:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d867dd8-78a6-5abc-a504-729d7225ccc2, identifier: YM04442
2026-03-30 09:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10d6190>
2026-03-30 09:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_6252f5722555e4b943bd6c09170ece23.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_6252f5722555e4b943bd6c09170ece23.jpg saved to cache
2026-03-30 09:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-03-30 09:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_4ea70924e065a63b06b747a7f8425e79.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:56 [auto1.it] INFO: Found listing with ID: EX40669
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX40669%27 HTTP/1.1" 200 None
2026-03-30 09:08:56 [auto1.it] INFO: Scrape type for EX40669: 2
2026-03-30 09:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25b99478-b0b3-521c-bb94-b685e6b33118 with identifier: EX40669
2026-03-30 09:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25b99478-b0b3-521c-bb94-b685e6b33118 with scrape type 2
2026-03-30 09:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25b99478-b0b3-521c-bb94-b685e6b33118 with scrape type 2
2026-03-30 09:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25b99478-b0b3-521c-bb94-b685e6b33118, identifier: EX40669
2026-03-30 09:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d867dd8-78a6-5abc-a504-729d7225ccc2 with identifier: YM04442
2026-03-30 09:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d867dd8-78a6-5abc-a504-729d7225ccc2 with identifier: YM04442
2026-03-30 09:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d867dd8-78a6-5abc-a504-729d7225ccc2 with identifier: YM04442 to the API
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:21:16Z',
 'fuel_type': 'petrol',
 'id': '9d867dd8-78a6-5abc-a504-729d7225ccc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM04442',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 90602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-26',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2011}
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM04442%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Saving data for YM04442: {'auction_closing_time': 1774970476.0, 'created_time': 1773479167.224127, 'last_price_update_time': 1774861737.031095}
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YM04442') HTTP/1.1" 204 0
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_29ecf7ddf1446d2544a49f727fbe12e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_29ecf7ddf1446d2544a49f727fbe12e1.jpg not downloaded yet
2026-03-30 09:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1085250>
2026-03-30 09:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_15c88d53f7a1555ba55cb4571b0c365e.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_15c88d53f7a1555ba55cb4571b0c365e.jpg saved to cache
2026-03-30 09:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-03-30 09:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_aede7d67c1f09ef31361085f0209ccd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25b99478-b0b3-521c-bb94-b685e6b33118 with identifier: EX40669
2026-03-30 09:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25b99478-b0b3-521c-bb94-b685e6b33118 with identifier: EX40669
2026-03-30 09:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 25b99478-b0b3-521c-bb94-b685e6b33118 with identifier: EX40669 to the API
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:47:17Z',
 'fuel_type': 'diesel',
 'id': '25b99478-b0b3-521c-bb94-b685e6b33118',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX40669',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 200805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-02-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2002}
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX40669%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Saving data for EX40669: {'auction_closing_time': 1774972037.0, 'created_time': 1774386757.140556, 'last_price_update_time': 1774861737.49476}
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EX40669') HTTP/1.1" 204 0
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: DW64097
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW64097%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Scrape type for DW64097: 2
2026-03-30 09:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bf5c71c-41f5-5ec6-852d-d5a9f8050b62 with identifier: DW64097
2026-03-30 09:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf5c71c-41f5-5ec6-852d-d5a9f8050b62 with scrape type 2
2026-03-30 09:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bf5c71c-41f5-5ec6-852d-d5a9f8050b62 with scrape type 2
2026-03-30 09:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7bf5c71c-41f5-5ec6-852d-d5a9f8050b62, identifier: DW64097
2026-03-30 09:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG07362> (referer: https://www.auto1.com/v1/car-details-view/NG07362/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12fb3d0>
2026-03-30 09:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_bcb50f43528b693f23ef4df6b8791026.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_bcb50f43528b693f23ef4df6b8791026.jpg saved to cache
2026-03-30 09:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5659553-81a0-57f8-9108-7f9c78423028
2026-03-30 09:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_381ab0f6074ae63bf8a8b1b92af94085.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: FL66155
2026-03-30 09:08:57 [auto1.it] INFO: Found listing with ID: PP47807
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP47807%27 HTTP/1.1" 200 None
2026-03-30 09:08:57 [auto1.it] INFO: Scrape type for PP47807: 2
2026-03-30 09:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af6413a1-2bdc-5917-abda-171fbf26b2d3 with identifier: PP47807
2026-03-30 09:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af6413a1-2bdc-5917-abda-171fbf26b2d3 with scrape type 2
2026-03-30 09:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af6413a1-2bdc-5917-abda-171fbf26b2d3 with scrape type 2
2026-03-30 09:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af6413a1-2bdc-5917-abda-171fbf26b2d3, identifier: PP47807
2026-03-30 09:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7bf5c71c-41f5-5ec6-852d-d5a9f8050b62 with identifier: DW64097
2026-03-30 09:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7bf5c71c-41f5-5ec6-852d-d5a9f8050b62 with identifier: DW64097
2026-03-30 09:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7bf5c71c-41f5-5ec6-852d-d5a9f8050b62 with identifier: DW64097 to the API
2026-03-30 09:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-31T15:03:04Z',
 'fuel_type': 'petrol',
 'id': '7bf5c71c-41f5-5ec6-852d-d5a9f8050b62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW64097',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 12860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-09',
 'seller_name': None,
 'title': 'Citroen C1 1.0 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW64097%27 HTTP/1.1" 200 None
2026-03-30 09:08:58 [auto1.it] INFO: Saving data for DW64097: {'auction_closing_time': 1774969384.0, 'created_time': 1773231901.332253, 'last_price_update_time': 1774861738.777508}
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW64097') HTTP/1.1" 204 0
2026-03-30 09:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee268b150>
2026-03-30 09:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_9ff9fa67d7d3c368792927de48fc209b.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_9ff9fa67d7d3c368792927de48fc209b.jpg saved to cache
2026-03-30 09:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-03-30 09:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af6413a1-2bdc-5917-abda-171fbf26b2d3 with identifier: PP47807
2026-03-30 09:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af6413a1-2bdc-5917-abda-171fbf26b2d3 with identifier: PP47807
2026-03-30 09:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af6413a1-2bdc-5917-abda-171fbf26b2d3 with identifier: PP47807 to the API
2026-03-30 09:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:18Z',
 'fuel_type': 'diesel',
 'id': 'af6413a1-2bdc-5917-abda-171fbf26b2d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP47807',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 112565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-30',
 'seller_name': None,
 'title': 'Honda CR-V 2.2 DTEC Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2011}
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP47807%27 HTTP/1.1" 200 None
2026-03-30 09:08:59 [auto1.it] INFO: Saving data for PP47807: {'auction_closing_time': 1774972698.0, 'created_time': 1773305169.831984, 'last_price_update_time': 1774861739.157988}
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PP47807') HTTP/1.1" 204 0
2026-03-30 09:08:59 [auto1.it] INFO: Found listing with ID: TU77617
2026-03-30 09:08:59 [auto1.it] INFO: Found listing with ID: AN44803
2026-03-30 09:08:59 [auto1.it] INFO: Found listing with ID: BG87604
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG87604%27 HTTP/1.1" 200 None
2026-03-30 09:08:59 [auto1.it] INFO: Scrape type for BG87604: 2
2026-03-30 09:08:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 716be74a-45d3-54bf-a9ca-9269d5dba1af with identifier: BG87604
2026-03-30 09:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 716be74a-45d3-54bf-a9ca-9269d5dba1af with scrape type 2
2026-03-30 09:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 716be74a-45d3-54bf-a9ca-9269d5dba1af with scrape type 2
2026-03-30 09:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 716be74a-45d3-54bf-a9ca-9269d5dba1af, identifier: BG87604
2026-03-30 09:08:59 [auto1.it] INFO: Channel: 24h | Page: 14 | totalHits: 3306 | hits on page: 40
2026-03-30 09:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee286a010>
2026-03-30 09:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_4ea70924e065a63b06b747a7f8425e79.jpg') HTTP/1.1" 204 0
2026-03-30 09:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_4ea70924e065a63b06b747a7f8425e79.jpg saved to cache
2026-03-30 09:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5659553-81a0-57f8-9108-7f9c78423028
2026-03-30 09:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_51faf5ecec3e3f77d2aa6f6fc9200536.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_892bc44e690190461fdfa589a5a0b1bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_cc4eb042c61fd15a4f4b69c8885470e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:08:59 [auto1.it] INFO: Found listing with ID: JV22884
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV22884%27 HTTP/1.1" 200 None
2026-03-30 09:08:59 [auto1.it] INFO: Scrape type for JV22884: 1
2026-03-30 09:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 716be74a-45d3-54bf-a9ca-9269d5dba1af with identifier: BG87604
2026-03-30 09:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 716be74a-45d3-54bf-a9ca-9269d5dba1af with identifier: BG87604
2026-03-30 09:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 716be74a-45d3-54bf-a9ca-9269d5dba1af with identifier: BG87604 to the API
2026-03-30 09:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:09:08Z',
 'fuel_type': 'diesel',
 'id': '716be74a-45d3-54bf-a9ca-9269d5dba1af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG87604',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 151917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-03',
 'seller_name': None,
 'title': 'Jaguar XF 20d Business Prestige',
 'transmission': 'automatic',
 'trim': 'Business Prestige',
 'year': 2017}
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG87604%27 HTTP/1.1" 200 None
2026-03-30 09:09:00 [auto1.it] INFO: Saving data for BG87604: {'auction_closing_time': 1774969748.0, 'created_time': 1773663959.383936, 'last_price_update_time': 1774861740.352972}
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BG87604') HTTP/1.1" 204 0
2026-03-30 09:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2505d10>
2026-03-30 09:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_aede7d67c1f09ef31361085f0209ccd9.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_aede7d67c1f09ef31361085f0209ccd9.jpg saved to cache
2026-03-30 09:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: KP13165
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: SZ37038
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ37038%27 HTTP/1.1" 200 None
2026-03-30 09:09:00 [auto1.it] INFO: Scrape type for SZ37038: 2
2026-03-30 09:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a0b176e-748c-5e3b-9c1f-d3122e5edbb2 with identifier: SZ37038
2026-03-30 09:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a0b176e-748c-5e3b-9c1f-d3122e5edbb2 with scrape type 2
2026-03-30 09:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a0b176e-748c-5e3b-9c1f-d3122e5edbb2 with scrape type 2
2026-03-30 09:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a0b176e-748c-5e3b-9c1f-d3122e5edbb2, identifier: SZ37038
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: WG28581
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: NN97027
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: LC35627
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: TD45829
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD45829%27 HTTP/1.1" 200 None
2026-03-30 09:09:00 [auto1.it] INFO: Scrape type for TD45829: 2
2026-03-30 09:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f1d095b-475c-57ef-834b-b64b3b2d1f52 with identifier: TD45829
2026-03-30 09:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f1d095b-475c-57ef-834b-b64b3b2d1f52 with scrape type 2
2026-03-30 09:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f1d095b-475c-57ef-834b-b64b3b2d1f52 with scrape type 2
2026-03-30 09:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f1d095b-475c-57ef-834b-b64b3b2d1f52, identifier: TD45829
2026-03-30 09:09:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bd5340a-5c83-5f99-bad1-d1d4e1b93564 with identifier: NG07362
2026-03-30 09:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564 with scrape type 1
2026-03-30 09:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_e9c57b993f4154c064508183ed281094.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_e9c57b993f4154c064508183ed281094.jpg not downloaded yet
2026-03-30 09:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11522d0>
2026-03-30 09:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_381ab0f6074ae63bf8a8b1b92af94085.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_381ab0f6074ae63bf8a8b1b92af94085.jpg saved to cache
2026-03-30 09:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5659553-81a0-57f8-9108-7f9c78423028
2026-03-30 09:09:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_2caeadc2f981951289b0e995cb9dc40a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:00 [auto1.it] INFO: Found listing with ID: PP82973
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP82973%27 HTTP/1.1" 200 None
2026-03-30 09:09:00 [auto1.it] INFO: Scrape type for PP82973: 2
2026-03-30 09:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 482b820e-43da-599d-885d-0c10d79d85a3 with identifier: PP82973
2026-03-30 09:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 482b820e-43da-599d-885d-0c10d79d85a3 with scrape type 2
2026-03-30 09:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 482b820e-43da-599d-885d-0c10d79d85a3 with scrape type 2
2026-03-30 09:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 482b820e-43da-599d-885d-0c10d79d85a3, identifier: PP82973
2026-03-30 09:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a0b176e-748c-5e3b-9c1f-d3122e5edbb2 with identifier: SZ37038
2026-03-30 09:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a0b176e-748c-5e3b-9c1f-d3122e5edbb2 with identifier: SZ37038
2026-03-30 09:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a0b176e-748c-5e3b-9c1f-d3122e5edbb2 with identifier: SZ37038 to the API
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:21:33Z',
 'fuel_type': 'petrol',
 'id': '7a0b176e-748c-5e3b-9c1f-d3122e5edbb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ37038',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 103777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2015}
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ37038%27 HTTP/1.1" 200 None
2026-03-30 09:09:01 [auto1.it] INFO: Saving data for SZ37038: {'auction_closing_time': 1774970493.0, 'created_time': 1774354577.54294, 'last_price_update_time': 1774861741.840388}
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SZ37038') HTTP/1.1" 204 0
2026-03-30 09:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f1d095b-475c-57ef-834b-b64b3b2d1f52 with identifier: TD45829
2026-03-30 09:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f1d095b-475c-57ef-834b-b64b3b2d1f52 with identifier: TD45829
2026-03-30 09:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f1d095b-475c-57ef-834b-b64b3b2d1f52 with identifier: TD45829 to the API
2026-03-30 09:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:50Z',
 'fuel_type': 'diesel',
 'id': '2f1d095b-475c-57ef-834b-b64b3b2d1f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD45829',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 64957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD45829%27 HTTP/1.1" 200 None
2026-03-30 09:09:02 [auto1.it] INFO: Saving data for TD45829: {'auction_closing_time': 1774970630.0, 'created_time': 1773954626.187095, 'last_price_update_time': 1774861742.207834}
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD45829') HTTP/1.1" 204 0
2026-03-30 09:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 482b820e-43da-599d-885d-0c10d79d85a3 with identifier: PP82973
2026-03-30 09:09:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 482b820e-43da-599d-885d-0c10d79d85a3 with identifier: PP82973
2026-03-30 09:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 482b820e-43da-599d-885d-0c10d79d85a3 with identifier: PP82973 to the API
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:33:47Z',
 'fuel_type': 'petrol',
 'id': '482b820e-43da-599d-885d-0c10d79d85a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP82973',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Musa',
 'odometer': 150996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-14',
 'seller_name': None,
 'title': 'Lancia Musa 1.4 Oro',
 'transmission': 'manual',
 'trim': 'Oro',
 'year': 2006}
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP82973%27 HTTP/1.1" 200 None
2026-03-30 09:09:02 [auto1.it] INFO: Saving data for PP82973: {'auction_closing_time': 1774971227.0, 'created_time': 1774559442.338037, 'last_price_update_time': 1774861742.590643}
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PP82973') HTTP/1.1" 204 0
2026-03-30 09:09:02 [auto1.it] INFO: Found listing with ID: ZZ51867
2026-03-30 09:09:02 [auto1.it] INFO: Found listing with ID: WV29949
2026-03-30 09:09:02 [auto1.it] INFO: Found listing with ID: DA44533
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA44533%27 HTTP/1.1" 200 None
2026-03-30 09:09:02 [auto1.it] INFO: Scrape type for DA44533: 2
2026-03-30 09:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b4d2ed-551c-5075-9b82-6cc1369394b5 with identifier: DA44533
2026-03-30 09:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b4d2ed-551c-5075-9b82-6cc1369394b5 with scrape type 2
2026-03-30 09:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b4d2ed-551c-5075-9b82-6cc1369394b5 with scrape type 2
2026-03-30 09:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f4b4d2ed-551c-5075-9b82-6cc1369394b5, identifier: DA44533
2026-03-30 09:09:02 [auto1.it] INFO: Found listing with ID: MB23093
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB23093%27 HTTP/1.1" 200 None
2026-03-30 09:09:02 [auto1.it] INFO: Scrape type for MB23093: 2
2026-03-30 09:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d172c393-3a2f-5af5-bb0a-82e7110ea046 with identifier: MB23093
2026-03-30 09:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d172c393-3a2f-5af5-bb0a-82e7110ea046 with scrape type 2
2026-03-30 09:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d172c393-3a2f-5af5-bb0a-82e7110ea046 with scrape type 2
2026-03-30 09:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d172c393-3a2f-5af5-bb0a-82e7110ea046, identifier: MB23093
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_deef4b3a97d5abe940115dd0738c546b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_deef4b3a97d5abe940115dd0738c546b.jpg not downloaded yet
2026-03-30 09:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW53472> (referer: https://www.auto1.com/v1/car-details-view/EW53472/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1430dd0>
2026-03-30 09:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fde%252Fa6dec7cf1a130ce8582712fed1bfbf4e%252Fpa%252FZT54121_51faf5ecec3e3f77d2aa6f6fc9200536.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_51faf5ecec3e3f77d2aa6f6fc9200536.jpg saved to cache
2026-03-30 09:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd
2026-03-30 09:09:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd, skipping ID generation
2026-03-30 09:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd with scrape type 1
2026-03-30 09:09:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd sending to next pipeline
2026-03-30 09:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd, identifier: ZT54121
2026-03-30 09:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2506350>
2026-03-30 09:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_892bc44e690190461fdfa589a5a0b1bc.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_892bc44e690190461fdfa589a5a0b1bc.jpg saved to cache
2026-03-30 09:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5659553-81a0-57f8-9108-7f9c78423028
2026-03-30 09:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee14437d0>
2026-03-30 09:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_cc4eb042c61fd15a4f4b69c8885470e9.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_cc4eb042c61fd15a4f4b69c8885470e9.jpg saved to cache
2026-03-30 09:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-03-30 09:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_29ecf7ddf1446d2544a49f727fbe12e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:03 [auto1.it] INFO: Found listing with ID: CU36699
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU36699%27 HTTP/1.1" 200 None
2026-03-30 09:09:03 [auto1.it] INFO: Scrape type for CU36699: 2
2026-03-30 09:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca0b445e-eb48-59b7-af50-096863a8b2fb with identifier: CU36699
2026-03-30 09:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca0b445e-eb48-59b7-af50-096863a8b2fb with scrape type 2
2026-03-30 09:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca0b445e-eb48-59b7-af50-096863a8b2fb with scrape type 2
2026-03-30 09:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ca0b445e-eb48-59b7-af50-096863a8b2fb, identifier: CU36699
2026-03-30 09:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f4b4d2ed-551c-5075-9b82-6cc1369394b5 with identifier: DA44533
2026-03-30 09:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f4b4d2ed-551c-5075-9b82-6cc1369394b5 with identifier: DA44533
2026-03-30 09:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f4b4d2ed-551c-5075-9b82-6cc1369394b5 with identifier: DA44533 to the API
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:17:32Z',
 'fuel_type': 'diesel',
 'id': 'f4b4d2ed-551c-5075-9b82-6cc1369394b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA44533',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 287285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-06',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA44533%27 HTTP/1.1" 200 None
2026-03-30 09:09:03 [auto1.it] INFO: Saving data for DA44533: {'auction_closing_time': 1774970252.0, 'created_time': 1773268408.508551, 'last_price_update_time': 1774861743.761772}
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA44533') HTTP/1.1" 204 0
2026-03-30 09:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d172c393-3a2f-5af5-bb0a-82e7110ea046 with identifier: MB23093
2026-03-30 09:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d172c393-3a2f-5af5-bb0a-82e7110ea046 with identifier: MB23093
2026-03-30 09:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d172c393-3a2f-5af5-bb0a-82e7110ea046 with identifier: MB23093 to the API
2026-03-30 09:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:08:08Z',
 'fuel_type': 'petrol',
 'id': 'd172c393-3a2f-5af5-bb0a-82e7110ea046',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB23093',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 23521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-24',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid XLine 2WD',
 'transmission': 'automatic',
 'trim': 'XLine 2WD',
 'year': 2023}
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB23093%27 HTTP/1.1" 200 None
2026-03-30 09:09:04 [auto1.it] INFO: Saving data for MB23093: {'auction_closing_time': 1774969688.0, 'created_time': 1774354076.18042, 'last_price_update_time': 1774861744.202498}
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MB23093') HTTP/1.1" 204 0
2026-03-30 09:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd with identifier: ZT54121
2026-03-30 09:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd with identifier: ZT54121
2026-03-30 09:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd with identifier: ZT54121 to the API
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_51faf5ecec3e3f77d2aa6f6fc9200536.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-31T15:15:55Z',
 'fuel_type': 'petrol',
 'id': 'ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT54121',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 34190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_68de8caabe93439d31009631fa76362a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_6a1413d6c7cf2fafedee9568d59be39a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_5acb2be6dbc19efc61cf931eec88fa65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_2f5a76218663a75ac0d49d50bf73e05b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_b48351d83d13d8a621b801652ae7818b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_82615f48a99ab37bc5c11e44a4c6c9a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_5f51b9644d280b09d34cd16ab5e433de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_ad235cbbae0f7d312b46902e14b3893c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_90eb8d49fe9c7fe014afe20582aa6862.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd/ca3741c3-d9d1-5308-bf6d-5b174f6fd6dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2845685,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/de/a6dec7cf1a130ce8582712fed1bfbf4e/pa/ZT54121_51faf5ecec3e3f77d2aa6f6fc9200536.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B4 Mild-Hybrid Plus Dark AWD',
 'transmission': 'automatic',
 'trim': 'Plus Dark AWD',
 'year': 2022}
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT54121%27 HTTP/1.1" 200 None
2026-03-30 09:09:04 [auto1.it] INFO: Saving data for ZT54121: {'created_time': 1774861744.650534, 'last_price_update_time': 1774861744.650554, 'auction_closing_time': 1774970155.0}
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZT54121') HTTP/1.1" 204 0
2026-03-30 09:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ca0b445e-eb48-59b7-af50-096863a8b2fb with identifier: CU36699
2026-03-30 09:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ca0b445e-eb48-59b7-af50-096863a8b2fb with identifier: CU36699
2026-03-30 09:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ca0b445e-eb48-59b7-af50-096863a8b2fb with identifier: CU36699 to the API
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:05:42Z',
 'fuel_type': 'petrol',
 'id': 'ca0b445e-eb48-59b7-af50-096863a8b2fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU36699',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 116294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-30',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2016}
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU36699%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Saving data for CU36699: {'auction_closing_time': 1774969542.0, 'created_time': 1774386324.657754, 'last_price_update_time': 1774861745.036059}
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CU36699') HTTP/1.1" 204 0
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: DX20771
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: EE84208
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE84208%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Scrape type for EE84208: 2
2026-03-30 09:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5abb1f83-a4ea-5b60-a238-3667b2aa80d9 with identifier: EE84208
2026-03-30 09:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5abb1f83-a4ea-5b60-a238-3667b2aa80d9 with scrape type 2
2026-03-30 09:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5abb1f83-a4ea-5b60-a238-3667b2aa80d9 with scrape type 2
2026-03-30 09:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5abb1f83-a4ea-5b60-a238-3667b2aa80d9, identifier: EE84208
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: FH22196
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: GS44368
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS44368%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Scrape type for GS44368: 2
2026-03-30 09:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b06fceae-931d-51c0-a4fb-46a82448b631 with identifier: GS44368
2026-03-30 09:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b06fceae-931d-51c0-a4fb-46a82448b631 with scrape type 2
2026-03-30 09:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b06fceae-931d-51c0-a4fb-46a82448b631 with scrape type 2
2026-03-30 09:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b06fceae-931d-51c0-a4fb-46a82448b631, identifier: GS44368
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_b01d01c913f2114a28692b9231e568ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_b01d01c913f2114a28692b9231e568ff.jpg not downloaded yet
2026-03-30 09:09:05 [scrapy.extensions.logstats] INFO: Crawled 196 pages (at 19 pages/min), scraped 265 items (at 93 items/min)
2026-03-30 09:09:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 09:09:05 [auto1.it] INFO: Found listing with ID: ZU45449
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU45449%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Scrape type for ZU45449: 2
2026-03-30 09:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade8c294-5029-57c4-a190-9682b3d4d7f9 with identifier: ZU45449
2026-03-30 09:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade8c294-5029-57c4-a190-9682b3d4d7f9 with scrape type 2
2026-03-30 09:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade8c294-5029-57c4-a190-9682b3d4d7f9 with scrape type 2
2026-03-30 09:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ade8c294-5029-57c4-a190-9682b3d4d7f9, identifier: ZU45449
2026-03-30 09:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5abb1f83-a4ea-5b60-a238-3667b2aa80d9 with identifier: EE84208
2026-03-30 09:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5abb1f83-a4ea-5b60-a238-3667b2aa80d9 with identifier: EE84208
2026-03-30 09:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5abb1f83-a4ea-5b60-a238-3667b2aa80d9 with identifier: EE84208 to the API
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:07:28Z',
 'fuel_type': 'diesel',
 'id': '5abb1f83-a4ea-5b60-a238-3667b2aa80d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE84208',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 302528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-03',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2011}
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE84208%27 HTTP/1.1" 200 None
2026-03-30 09:09:05 [auto1.it] INFO: Saving data for EE84208: {'auction_closing_time': 1774969648.0, 'created_time': 1773231965.19587, 'last_price_update_time': 1774861745.778662}
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EE84208') HTTP/1.1" 204 0
2026-03-30 09:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b06fceae-931d-51c0-a4fb-46a82448b631 with identifier: GS44368
2026-03-30 09:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b06fceae-931d-51c0-a4fb-46a82448b631 with identifier: GS44368
2026-03-30 09:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b06fceae-931d-51c0-a4fb-46a82448b631 with identifier: GS44368 to the API
2026-03-30 09:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:34:59Z',
 'fuel_type': 'diesel',
 'id': 'b06fceae-931d-51c0-a4fb-46a82448b631',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS44368',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 226089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-14',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS44368%27 HTTP/1.1" 200 None
2026-03-30 09:09:06 [auto1.it] INFO: Saving data for GS44368: {'auction_closing_time': 1774971299.0, 'created_time': 1774354085.883826, 'last_price_update_time': 1774861746.754446}
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GS44368') HTTP/1.1" 204 0
2026-03-30 09:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c6890>
2026-03-30 09:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_2caeadc2f981951289b0e995cb9dc40a.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_2caeadc2f981951289b0e995cb9dc40a.jpg saved to cache
2026-03-30 09:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5659553-81a0-57f8-9108-7f9c78423028
2026-03-30 09:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21fa1551-09ac-5403-9288-f1583e434852 with identifier: EW53472
2026-03-30 09:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21fa1551-09ac-5403-9288-f1583e434852 with scrape type 1
2026-03-30 09:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21fa1551-09ac-5403-9288-f1583e434852
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_4c9e0949a8bd4351f1314207d4711514.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_4c9e0949a8bd4351f1314207d4711514.jpg not downloaded yet
2026-03-30 09:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ade8c294-5029-57c4-a190-9682b3d4d7f9 with identifier: ZU45449
2026-03-30 09:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ade8c294-5029-57c4-a190-9682b3d4d7f9 with identifier: ZU45449
2026-03-30 09:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ade8c294-5029-57c4-a190-9682b3d4d7f9 with identifier: ZU45449 to the API
2026-03-30 09:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:32:31Z',
 'fuel_type': 'diesel',
 'id': 'ade8c294-5029-57c4-a190-9682b3d4d7f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU45449',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 221968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-29',
 'seller_name': None,
 'title': 'Kia Carens 1.7 CRDi Class',
 'transmission': 'automatic',
 'trim': 'Class',
 'year': 2014}
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU45449%27 HTTP/1.1" 200 None
2026-03-30 09:09:07 [auto1.it] INFO: Saving data for ZU45449: {'auction_closing_time': 1774971151.0, 'created_time': 1773231725.160752, 'last_price_update_time': 1774861747.168105}
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU45449') HTTP/1.1" 204 0
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: TU90316
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: MX50027
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: GZ10906
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: PH85251
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH85251%27 HTTP/1.1" 200 None
2026-03-30 09:09:07 [auto1.it] INFO: Scrape type for PH85251: 2
2026-03-30 09:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c7933b0-0896-5b38-9df8-5aab494a401a with identifier: PH85251
2026-03-30 09:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c7933b0-0896-5b38-9df8-5aab494a401a with scrape type 2
2026-03-30 09:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c7933b0-0896-5b38-9df8-5aab494a401a with scrape type 2
2026-03-30 09:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c7933b0-0896-5b38-9df8-5aab494a401a, identifier: PH85251
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: SC01107
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: PV08613
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: DW05477
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: PH30098
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: AL46082
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: XT15481
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: BM94525
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: NC77836
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC77836%27 HTTP/1.1" 200 None
2026-03-30 09:09:07 [auto1.it] INFO: Scrape type for NC77836: 2
2026-03-30 09:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49ad3e38-98cf-50a5-bc26-a69553fbbe86 with identifier: NC77836
2026-03-30 09:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49ad3e38-98cf-50a5-bc26-a69553fbbe86 with scrape type 2
2026-03-30 09:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49ad3e38-98cf-50a5-bc26-a69553fbbe86 with scrape type 2
2026-03-30 09:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49ad3e38-98cf-50a5-bc26-a69553fbbe86, identifier: NC77836
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_0ebe6a53bf57e2503f67256d077e7d56.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_0ebe6a53bf57e2503f67256d077e7d56.jpg not downloaded yet
2026-03-30 09:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_e9c57b993f4154c064508183ed281094.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:07 [auto1.it] INFO: Found listing with ID: ZV41992
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV41992%27 HTTP/1.1" 200 None
2026-03-30 09:09:07 [auto1.it] INFO: Scrape type for ZV41992: 2
2026-03-30 09:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c5a0414-8d51-5aea-90f7-f112f8d44075 with identifier: ZV41992
2026-03-30 09:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5a0414-8d51-5aea-90f7-f112f8d44075 with scrape type 2
2026-03-30 09:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c5a0414-8d51-5aea-90f7-f112f8d44075 with scrape type 2
2026-03-30 09:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1c5a0414-8d51-5aea-90f7-f112f8d44075, identifier: ZV41992
2026-03-30 09:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c7933b0-0896-5b38-9df8-5aab494a401a with identifier: PH85251
2026-03-30 09:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c7933b0-0896-5b38-9df8-5aab494a401a with identifier: PH85251
2026-03-30 09:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c7933b0-0896-5b38-9df8-5aab494a401a with identifier: PH85251 to the API
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:13:11Z',
 'fuel_type': 'petrol',
 'id': '5c7933b0-0896-5b38-9df8-5aab494a401a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH85251',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 175213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-17',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH85251%27 HTTP/1.1" 200 None
2026-03-30 09:09:07 [auto1.it] INFO: Saving data for PH85251: {'auction_closing_time': 1774969991.0, 'created_time': 1773130303.29264, 'last_price_update_time': 1774861747.895003}
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PH85251') HTTP/1.1" 204 0
2026-03-30 09:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49ad3e38-98cf-50a5-bc26-a69553fbbe86 with identifier: NC77836
2026-03-30 09:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49ad3e38-98cf-50a5-bc26-a69553fbbe86 with identifier: NC77836
2026-03-30 09:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49ad3e38-98cf-50a5-bc26-a69553fbbe86 with identifier: NC77836 to the API
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:35:00Z',
 'fuel_type': 'diesel',
 'id': '49ad3e38-98cf-50a5-bc26-a69553fbbe86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC77836',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 130751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-29',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic',
 'transmission': 'automatic',
 'trim': 'R-Dynamic',
 'year': 2017}
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC77836%27 HTTP/1.1" 200 None
2026-03-30 09:09:08 [auto1.it] INFO: Saving data for NC77836: {'auction_closing_time': 1774971300.0, 'created_time': 1774386771.506085, 'last_price_update_time': 1774861748.384833}
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NC77836') HTTP/1.1" 204 0
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_d8d248e854fb9fc0461624982b9ad69c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_d8d248e854fb9fc0461624982b9ad69c.jpg not downloaded yet
2026-03-30 09:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2575890>
2026-03-30 09:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe9%252Fdee9ff1add50d3e0f60ab2cb58a81dbb%252Fpa%252FJH80469_29ecf7ddf1446d2544a49f727fbe12e1.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_29ecf7ddf1446d2544a49f727fbe12e1.jpg saved to cache
2026-03-30 09:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5659553-81a0-57f8-9108-7f9c78423028
2026-03-30 09:09:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5659553-81a0-57f8-9108-7f9c78423028, skipping ID generation
2026-03-30 09:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5659553-81a0-57f8-9108-7f9c78423028 with scrape type 1
2026-03-30 09:09:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5659553-81a0-57f8-9108-7f9c78423028 sending to next pipeline
2026-03-30 09:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5659553-81a0-57f8-9108-7f9c78423028, identifier: JH80469
2026-03-30 09:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1c5a0414-8d51-5aea-90f7-f112f8d44075 with identifier: ZV41992
2026-03-30 09:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1c5a0414-8d51-5aea-90f7-f112f8d44075 with identifier: ZV41992
2026-03-30 09:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1c5a0414-8d51-5aea-90f7-f112f8d44075 with identifier: ZV41992 to the API
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:36:55Z',
 'fuel_type': 'gas',
 'id': '1c5a0414-8d51-5aea-90f7-f112f8d44075',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV41992',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 126847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-21',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2011}
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV41992%27 HTTP/1.1" 200 None
2026-03-30 09:09:08 [auto1.it] INFO: Saving data for ZV41992: {'auction_closing_time': 1774971415.0, 'created_time': 1774361323.494319, 'last_price_update_time': 1774861748.935772}
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZV41992') HTTP/1.1" 204 0
2026-03-30 09:09:08 [auto1.it] INFO: Found listing with ID: HG99110
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG99110%27 HTTP/1.1" 200 None
2026-03-30 09:09:08 [auto1.it] INFO: Scrape type for HG99110: 2
2026-03-30 09:09:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c854745-ed17-5fa2-b2a1-3c30b82c4d1c with identifier: HG99110
2026-03-30 09:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c854745-ed17-5fa2-b2a1-3c30b82c4d1c with scrape type 2
2026-03-30 09:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c854745-ed17-5fa2-b2a1-3c30b82c4d1c with scrape type 2
2026-03-30 09:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c854745-ed17-5fa2-b2a1-3c30b82c4d1c, identifier: HG99110
2026-03-30 09:09:09 [auto1.it] INFO: Found listing with ID: TT40811
2026-03-30 09:09:09 [auto1.it] INFO: Found listing with ID: AF16570
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF16570%27 HTTP/1.1" 200 None
2026-03-30 09:09:09 [auto1.it] INFO: Scrape type for AF16570: 2
2026-03-30 09:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb1b8674-7654-5888-97cf-431ad958b84b with identifier: AF16570
2026-03-30 09:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb1b8674-7654-5888-97cf-431ad958b84b with scrape type 2
2026-03-30 09:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb1b8674-7654-5888-97cf-431ad958b84b with scrape type 2
2026-03-30 09:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb1b8674-7654-5888-97cf-431ad958b84b, identifier: AF16570
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_ed7ed7492108d83ed43c0db4aa9468c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_ed7ed7492108d83ed43c0db4aa9468c2.jpg not downloaded yet
2026-03-30 09:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5659553-81a0-57f8-9108-7f9c78423028 with identifier: JH80469
2026-03-30 09:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5659553-81a0-57f8-9108-7f9c78423028 with identifier: JH80469
2026-03-30 09:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5659553-81a0-57f8-9108-7f9c78423028 with identifier: JH80469 to the API
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_29ecf7ddf1446d2544a49f727fbe12e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:24:43Z',
 'fuel_type': 'petrol',
 'id': 'a5659553-81a0-57f8-9108-7f9c78423028',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH80469',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 173844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_55c6bb517bc8cac7da952ed31d4dddeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 155653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_5711a308d834e04289735de2159f67fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_9b4572e7a6ecc038b855d18156f422bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_7dbd9e41f92ce8730be78d7b360b3405.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_bcb50f43528b693f23ef4df6b8791026.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_4ea70924e065a63b06b747a7f8425e79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_381ab0f6074ae63bf8a8b1b92af94085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_892bc44e690190461fdfa589a5a0b1bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_2caeadc2f981951289b0e995cb9dc40a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5659553-81a0-57f8-9108-7f9c78423028/a5659553-81a0-57f8-9108-7f9c78423028_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/e9/dee9ff1add50d3e0f60ab2cb58a81dbb/pa/JH80469_29ecf7ddf1446d2544a49f727fbe12e1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.4 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH80469%27 HTTP/1.1" 200 None
2026-03-30 09:09:09 [auto1.it] INFO: Saving data for JH80469: {'created_time': 1774861749.670711, 'last_price_update_time': 1774861749.670725, 'auction_closing_time': 1774970683.0}
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JH80469') HTTP/1.1" 204 0
2026-03-30 09:09:09 [auto1.it] INFO: Found listing with ID: PG97682
2026-03-30 09:09:09 [auto1.it] INFO: Found listing with ID: XR25970
2026-03-30 09:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c854745-ed17-5fa2-b2a1-3c30b82c4d1c with identifier: HG99110
2026-03-30 09:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c854745-ed17-5fa2-b2a1-3c30b82c4d1c with identifier: HG99110
2026-03-30 09:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c854745-ed17-5fa2-b2a1-3c30b82c4d1c with identifier: HG99110 to the API
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:24:30Z',
 'fuel_type': 'petrol',
 'id': '4c854745-ed17-5fa2-b2a1-3c30b82c4d1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG99110',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 137411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-13',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2021}
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG99110%27 HTTP/1.1" 200 None
2026-03-30 09:09:10 [auto1.it] INFO: Saving data for HG99110: {'auction_closing_time': 1774970670.0, 'created_time': 1773522494.854991, 'last_price_update_time': 1774861750.054281}
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG99110') HTTP/1.1" 204 0
2026-03-30 09:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb1b8674-7654-5888-97cf-431ad958b84b with identifier: AF16570
2026-03-30 09:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb1b8674-7654-5888-97cf-431ad958b84b with identifier: AF16570
2026-03-30 09:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb1b8674-7654-5888-97cf-431ad958b84b with identifier: AF16570 to the API
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:37:37Z',
 'fuel_type': 'petrol',
 'id': 'cb1b8674-7654-5888-97cf-431ad958b84b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF16570',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 43359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF16570%27 HTTP/1.1" 200 None
2026-03-30 09:09:10 [auto1.it] INFO: Saving data for AF16570: {'auction_closing_time': 1774971457.0, 'created_time': 1773868531.773337, 'last_price_update_time': 1774861750.40595}
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF16570') HTTP/1.1" 204 0
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_d6572085ffcb1d220bd29c62bbb77643.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_d6572085ffcb1d220bd29c62bbb77643.jpg not downloaded yet
2026-03-30 09:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_deef4b3a97d5abe940115dd0738c546b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:10 [auto1.it] INFO: Found listing with ID: LS67474
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS67474%27 HTTP/1.1" 200 None
2026-03-30 09:09:10 [auto1.it] INFO: Scrape type for LS67474: 2
2026-03-30 09:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e006f57a-b46e-54fd-ae61-a59841e9f7ee with identifier: LS67474
2026-03-30 09:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e006f57a-b46e-54fd-ae61-a59841e9f7ee with scrape type 2
2026-03-30 09:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e006f57a-b46e-54fd-ae61-a59841e9f7ee with scrape type 2
2026-03-30 09:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e006f57a-b46e-54fd-ae61-a59841e9f7ee, identifier: LS67474
2026-03-30 09:09:10 [auto1.it] INFO: Found listing with ID: CE09318
2026-03-30 09:09:10 [auto1.it] INFO: Found listing with ID: MG39360
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG39360%27 HTTP/1.1" 200 None
2026-03-30 09:09:10 [auto1.it] INFO: Scrape type for MG39360: 2
2026-03-30 09:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bddcbdcd-a1e8-54ba-9eee-3305cd4c18dd with identifier: MG39360
2026-03-30 09:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bddcbdcd-a1e8-54ba-9eee-3305cd4c18dd with scrape type 2
2026-03-30 09:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bddcbdcd-a1e8-54ba-9eee-3305cd4c18dd with scrape type 2
2026-03-30 09:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bddcbdcd-a1e8-54ba-9eee-3305cd4c18dd, identifier: MG39360
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_cc3f4214bde41587f441b03c74259a18.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_cc3f4214bde41587f441b03c74259a18.jpg not downloaded yet
2026-03-30 09:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee253bd90>
2026-03-30 09:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_e9c57b993f4154c064508183ed281094.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_e9c57b993f4154c064508183ed281094.jpg saved to cache
2026-03-30 09:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564
2026-03-30 09:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_b01d01c913f2114a28692b9231e568ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e006f57a-b46e-54fd-ae61-a59841e9f7ee with identifier: LS67474
2026-03-30 09:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e006f57a-b46e-54fd-ae61-a59841e9f7ee with identifier: LS67474
2026-03-30 09:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e006f57a-b46e-54fd-ae61-a59841e9f7ee with identifier: LS67474 to the API
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:42:20Z',
 'fuel_type': 'diesel',
 'id': 'e006f57a-b46e-54fd-ae61-a59841e9f7ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS67474',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 245699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-29',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2011}
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS67474%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Saving data for LS67474: {'auction_closing_time': 1774971740.0, 'created_time': 1774386570.941263, 'last_price_update_time': 1774861751.075458}
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LS67474') HTTP/1.1" 204 0
2026-03-30 09:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bddcbdcd-a1e8-54ba-9eee-3305cd4c18dd with identifier: MG39360
2026-03-30 09:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bddcbdcd-a1e8-54ba-9eee-3305cd4c18dd with identifier: MG39360
2026-03-30 09:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bddcbdcd-a1e8-54ba-9eee-3305cd4c18dd with identifier: MG39360 to the API
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:47:07Z',
 'fuel_type': 'diesel',
 'id': 'bddcbdcd-a1e8-54ba-9eee-3305cd4c18dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG39360',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 226919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2019}
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG39360%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Saving data for MG39360: {'auction_closing_time': 1774972027.0, 'created_time': 1774041000.175471, 'last_price_update_time': 1774861751.439143}
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MG39360') HTTP/1.1" 204 0
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_23d730db80401224f098316622a2c22a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_23d730db80401224f098316622a2c22a.jpg not downloaded yet
2026-03-30 09:09:11 [auto1.it] INFO: Found listing with ID: WJ69622
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ69622%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Scrape type for WJ69622: 2
2026-03-30 09:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f248b69e-a7d4-58e2-b85d-13134c2d689d with identifier: WJ69622
2026-03-30 09:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f248b69e-a7d4-58e2-b85d-13134c2d689d with scrape type 2
2026-03-30 09:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f248b69e-a7d4-58e2-b85d-13134c2d689d with scrape type 2
2026-03-30 09:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f248b69e-a7d4-58e2-b85d-13134c2d689d, identifier: WJ69622
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_c648004e72158342c77fe98a0748a40f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_c648004e72158342c77fe98a0748a40f.jpg not downloaded yet
2026-03-30 09:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_0ebe6a53bf57e2503f67256d077e7d56.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f248b69e-a7d4-58e2-b85d-13134c2d689d with identifier: WJ69622
2026-03-30 09:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f248b69e-a7d4-58e2-b85d-13134c2d689d with identifier: WJ69622
2026-03-30 09:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f248b69e-a7d4-58e2-b85d-13134c2d689d with identifier: WJ69622 to the API
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:12:30Z',
 'fuel_type': 'diesel',
 'id': 'f248b69e-a7d4-58e2-b85d-13134c2d689d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ69622',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 301496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-06',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2011}
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ69622%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [auto1.it] INFO: Saving data for WJ69622: {'auction_closing_time': 1774969950.0, 'created_time': 1774300297.99953, 'last_price_update_time': 1774861751.95272}
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WJ69622') HTTP/1.1" 204 0
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_b8005b9e9f84b68751cedbc5fed01b4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_b8005b9e9f84b68751cedbc5fed01b4c.jpg not downloaded yet
2026-03-30 09:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10b8710>
2026-03-30 09:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_deef4b3a97d5abe940115dd0738c546b.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_deef4b3a97d5abe940115dd0738c546b.jpg saved to cache
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564
2026-03-30 09:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_d8d248e854fb9fc0461624982b9ad69c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: SD48843
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD48843%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Scrape type for SD48843: 2
2026-03-30 09:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ded2c5ca-a310-542a-a188-79bf88156789 with identifier: SD48843
2026-03-30 09:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ded2c5ca-a310-542a-a188-79bf88156789 with scrape type 2
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ded2c5ca-a310-542a-a188-79bf88156789 with scrape type 2
2026-03-30 09:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ded2c5ca-a310-542a-a188-79bf88156789, identifier: SD48843
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_705284614cf13ee53883e791ddef7e25.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_705284614cf13ee53883e791ddef7e25.jpg not downloaded yet
2026-03-30 09:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2567010>
2026-03-30 09:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_b01d01c913f2114a28692b9231e568ff.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_b01d01c913f2114a28692b9231e568ff.jpg saved to cache
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564
2026-03-30 09:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ded2c5ca-a310-542a-a188-79bf88156789 with identifier: SD48843
2026-03-30 09:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ded2c5ca-a310-542a-a188-79bf88156789 with identifier: SD48843
2026-03-30 09:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ded2c5ca-a310-542a-a188-79bf88156789 with identifier: SD48843 to the API
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:22:09Z',
 'fuel_type': 'petrol',
 'id': 'ded2c5ca-a310-542a-a188-79bf88156789',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD48843',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 133110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-16',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2013}
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD48843%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Saving data for SD48843: {'auction_closing_time': 1774970529.0, 'created_time': 1774354275.751505, 'last_price_update_time': 1774861752.598056}
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD48843') HTTP/1.1" 204 0
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_202c1267f8d0fef8881e7a382ae84628.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_202c1267f8d0fef8881e7a382ae84628.jpg not downloaded yet
2026-03-30 09:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_ed7ed7492108d83ed43c0db4aa9468c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:12 [auto1.it] INFO: Found listing with ID: GG46120
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG46120%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [auto1.it] INFO: Scrape type for GG46120: 2
2026-03-30 09:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10e875a5-66e9-5121-beb5-1e928d48ad16 with identifier: GG46120
2026-03-30 09:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10e875a5-66e9-5121-beb5-1e928d48ad16 with scrape type 2
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10e875a5-66e9-5121-beb5-1e928d48ad16 with scrape type 2
2026-03-30 09:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 10e875a5-66e9-5121-beb5-1e928d48ad16, identifier: GG46120
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_88161da93636083280903fb6a1ac6c92.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_88161da93636083280903fb6a1ac6c92.jpg not downloaded yet
2026-03-30 09:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12187d0>
2026-03-30 09:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_0ebe6a53bf57e2503f67256d077e7d56.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_0ebe6a53bf57e2503f67256d077e7d56.jpg saved to cache
2026-03-30 09:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564
2026-03-30 09:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_cc3f4214bde41587f441b03c74259a18.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 10e875a5-66e9-5121-beb5-1e928d48ad16 with identifier: GG46120
2026-03-30 09:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 10e875a5-66e9-5121-beb5-1e928d48ad16 with identifier: GG46120
2026-03-30 09:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 10e875a5-66e9-5121-beb5-1e928d48ad16 with identifier: GG46120 to the API
2026-03-30 09:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:03:55Z',
 'fuel_type': 'diesel',
 'id': '10e875a5-66e9-5121-beb5-1e928d48ad16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG46120',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 177612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-13',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2009}
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG46120%27 HTTP/1.1" 200 None
2026-03-30 09:09:13 [auto1.it] INFO: Saving data for GG46120: {'auction_closing_time': 1774969435.0, 'created_time': 1774386531.669257, 'last_price_update_time': 1774861753.173415}
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GG46120') HTTP/1.1" 204 0
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_3123b57b7741249c3fd1feeeec699cdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_3123b57b7741249c3fd1feeeec699cdd.jpg not downloaded yet
2026-03-30 09:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1205ad0>
2026-03-30 09:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_d8d248e854fb9fc0461624982b9ad69c.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_d8d248e854fb9fc0461624982b9ad69c.jpg saved to cache
2026-03-30 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21fa1551-09ac-5403-9288-f1583e434852
2026-03-30 09:09:13 [auto1.it] INFO: Found listing with ID: SC05830
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05830%27 HTTP/1.1" 200 None
2026-03-30 09:09:13 [auto1.it] INFO: Scrape type for SC05830: 2
2026-03-30 09:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac5aa65b-00ce-52f6-a4fb-4b36a5fb0054 with identifier: SC05830
2026-03-30 09:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac5aa65b-00ce-52f6-a4fb-4b36a5fb0054 with scrape type 2
2026-03-30 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac5aa65b-00ce-52f6-a4fb-4b36a5fb0054 with scrape type 2
2026-03-30 09:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac5aa65b-00ce-52f6-a4fb-4b36a5fb0054, identifier: SC05830
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_b2d7dc17bb35db95cdc6fa216f76536a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_b2d7dc17bb35db95cdc6fa216f76536a.jpg not downloaded yet
2026-03-30 09:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_67c6dfe42b3d913f8417eb988dfcf147.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_c648004e72158342c77fe98a0748a40f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac5aa65b-00ce-52f6-a4fb-4b36a5fb0054 with identifier: SC05830
2026-03-30 09:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac5aa65b-00ce-52f6-a4fb-4b36a5fb0054 with identifier: SC05830
2026-03-30 09:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ac5aa65b-00ce-52f6-a4fb-4b36a5fb0054 with identifier: SC05830 to the API
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:06:07Z',
 'fuel_type': 'diesel',
 'id': 'ac5aa65b-00ce-52f6-a4fb-4b36a5fb0054',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC05830',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 36799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-28',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TDI S line',
 'transmission': 'manual',
 'trim': 'S line',
 'year': 2023}
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05830%27 HTTP/1.1" 200 None
2026-03-30 09:09:13 [auto1.it] INFO: Saving data for SC05830: {'auction_closing_time': 1774969567.0, 'created_time': 1774002249.130298, 'last_price_update_time': 1774861753.853775}
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC05830') HTTP/1.1" 204 0
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_17c4178fc738e96a552e3cd6051833f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_17c4178fc738e96a552e3cd6051833f1.jpg not downloaded yet
2026-03-30 09:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee45e7050>
2026-03-30 09:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_ed7ed7492108d83ed43c0db4aa9468c2.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_ed7ed7492108d83ed43c0db4aa9468c2.jpg saved to cache
2026-03-30 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564
2026-03-30 09:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_b8005b9e9f84b68751cedbc5fed01b4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:13 [auto1.it] INFO: Found listing with ID: EV67408
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV67408%27 HTTP/1.1" 200 None
2026-03-30 09:09:13 [auto1.it] INFO: Scrape type for EV67408: 2
2026-03-30 09:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15cd7485-a3eb-5225-a611-cf0c87939cbc with identifier: EV67408
2026-03-30 09:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15cd7485-a3eb-5225-a611-cf0c87939cbc with scrape type 2
2026-03-30 09:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15cd7485-a3eb-5225-a611-cf0c87939cbc with scrape type 2
2026-03-30 09:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 15cd7485-a3eb-5225-a611-cf0c87939cbc, identifier: EV67408
2026-03-30 09:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV22884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12e7b10>
2026-03-30 09:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_cc3f4214bde41587f441b03c74259a18.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_cc3f4214bde41587f441b03c74259a18.jpg saved to cache
2026-03-30 09:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564
2026-03-30 09:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 15cd7485-a3eb-5225-a611-cf0c87939cbc with identifier: EV67408
2026-03-30 09:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 15cd7485-a3eb-5225-a611-cf0c87939cbc with identifier: EV67408
2026-03-30 09:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 15cd7485-a3eb-5225-a611-cf0c87939cbc with identifier: EV67408 to the API
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:35:26Z',
 'fuel_type': 'petrol',
 'id': '15cd7485-a3eb-5225-a611-cf0c87939cbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV67408',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 159383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-26',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2018}
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV67408%27 HTTP/1.1" 200 None
2026-03-30 09:09:14 [auto1.it] INFO: Saving data for EV67408: {'auction_closing_time': 1774971326.0, 'created_time': 1774008341.109016, 'last_price_update_time': 1774861754.44776}
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EV67408') HTTP/1.1" 204 0
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_2e140f3352a83baca945e72e581e640a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_2e140f3352a83baca945e72e581e640a.jpg not downloaded yet
2026-03-30 09:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_705284614cf13ee53883e791ddef7e25.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_202c1267f8d0fef8881e7a382ae84628.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: EC33452
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: CV62006
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: KZ82470
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: GU28571
2026-03-30 09:09:14 [auto1.it] INFO: Found listing with ID: JR58034
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR58034%27 HTTP/1.1" 200 None
2026-03-30 09:09:14 [auto1.it] INFO: Scrape type for JR58034: 2
2026-03-30 09:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d081a8c4-feb6-5e17-8ffd-3b9fd152bedd with identifier: JR58034
2026-03-30 09:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d081a8c4-feb6-5e17-8ffd-3b9fd152bedd with scrape type 2
2026-03-30 09:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d081a8c4-feb6-5e17-8ffd-3b9fd152bedd with scrape type 2
2026-03-30 09:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d081a8c4-feb6-5e17-8ffd-3b9fd152bedd, identifier: JR58034
2026-03-30 09:09:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10b9b50>
2026-03-30 09:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F39%252F9239951af54b761acc60b75d1c70cc9d%252Fpa%252FSX71536_67c6dfe42b3d913f8417eb988dfcf147.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_67c6dfe42b3d913f8417eb988dfcf147.jpg saved to cache
2026-03-30 09:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-03-30 09:09:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b7ad6d0-a179-5410-985c-d85258b21310, skipping ID generation
2026-03-30 09:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b7ad6d0-a179-5410-985c-d85258b21310 with scrape type 1
2026-03-30 09:09:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b7ad6d0-a179-5410-985c-d85258b21310 sending to next pipeline
2026-03-30 09:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b7ad6d0-a179-5410-985c-d85258b21310, identifier: SX71536
2026-03-30 09:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12fbc90>
2026-03-30 09:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_c648004e72158342c77fe98a0748a40f.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_c648004e72158342c77fe98a0748a40f.jpg saved to cache
2026-03-30 09:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564
2026-03-30 09:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_3123b57b7741249c3fd1feeeec699cdd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d081a8c4-feb6-5e17-8ffd-3b9fd152bedd with identifier: JR58034
2026-03-30 09:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d081a8c4-feb6-5e17-8ffd-3b9fd152bedd with identifier: JR58034
2026-03-30 09:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d081a8c4-feb6-5e17-8ffd-3b9fd152bedd with identifier: JR58034 to the API
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:08:26Z',
 'fuel_type': 'petrol',
 'id': 'd081a8c4-feb6-5e17-8ffd-3b9fd152bedd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR58034',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 98954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-11',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2019}
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR58034%27 HTTP/1.1" 200 None
2026-03-30 09:09:15 [auto1.it] INFO: Saving data for JR58034: {'auction_closing_time': 1774969706.0, 'created_time': 1774040725.117733, 'last_price_update_time': 1774861755.500252}
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JR58034') HTTP/1.1" 204 0
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_a3e61408a2f5051d77153cc742edba6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_a3e61408a2f5051d77153cc742edba6d.jpg not downloaded yet
2026-03-30 09:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b7ad6d0-a179-5410-985c-d85258b21310 with identifier: SX71536
2026-03-30 09:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b7ad6d0-a179-5410-985c-d85258b21310 with identifier: SX71536
2026-03-30 09:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5b7ad6d0-a179-5410-985c-d85258b21310 with identifier: SX71536 to the API
2026-03-30 09:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_67c6dfe42b3d913f8417eb988dfcf147.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.2L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:46:25Z',
 'fuel_type': 'diesel',
 'id': '5b7ad6d0-a179-5410-985c-d85258b21310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX71536',
 'listing': 'auction',
 'location': 'IT, Gallarate',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 199147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_43377955fbb3e7ca0696618d850078c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_fd8b7d2ac97930233fb6a2ac09f7ca75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_7a7e019ae5eaea991df2a129126cbc81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2178518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_67c6dfe42b3d913f8417eb988dfcf147.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_86514e277eef9dc106c6cc3138bfff7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_6252f5722555e4b943bd6c09170ece23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_15c88d53f7a1555ba55cb4571b0c365e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_9ff9fa67d7d3c368792927de48fc209b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_aede7d67c1f09ef31361085f0209ccd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_cc4eb042c61fd15a4f4b69c8885470e9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Instyle 4WD',
 'transmission': 'manual',
 'trim': 'Instyle 4WD',
 'year': 2010}
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX71536%27 HTTP/1.1" 200 None
2026-03-30 09:09:16 [auto1.it] INFO: Saving data for SX71536: {'created_time': 1774861756.162007, 'last_price_update_time': 1774861756.162018, 'auction_closing_time': 1774971985.0}
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SX71536') HTTP/1.1" 204 0
2026-03-30 09:09:16 [auto1.it] INFO: Channel: 24h | Page: 15 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1244810>
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_b8005b9e9f84b68751cedbc5fed01b4c.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_b8005b9e9f84b68751cedbc5fed01b4c.jpg saved to cache
2026-03-30 09:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21fa1551-09ac-5403-9288-f1583e434852
2026-03-30 09:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_88161da93636083280903fb6a1ac6c92.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: CE19037
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE19037%27 HTTP/1.1" 200 None
2026-03-30 09:09:16 [auto1.it] INFO: Scrape type for CE19037: 2
2026-03-30 09:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d5ea272-8939-570a-a48d-ed27e11382b2 with identifier: CE19037
2026-03-30 09:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d5ea272-8939-570a-a48d-ed27e11382b2 with scrape type 2
2026-03-30 09:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d5ea272-8939-570a-a48d-ed27e11382b2 with scrape type 2
2026-03-30 09:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d5ea272-8939-570a-a48d-ed27e11382b2, identifier: CE19037
2026-03-30 09:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_b2d7dc17bb35db95cdc6fa216f76536a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d5ea272-8939-570a-a48d-ed27e11382b2 with identifier: CE19037
2026-03-30 09:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d5ea272-8939-570a-a48d-ed27e11382b2 with identifier: CE19037
2026-03-30 09:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d5ea272-8939-570a-a48d-ed27e11382b2 with identifier: CE19037 to the API
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:14:07Z',
 'fuel_type': 'diesel',
 'id': '4d5ea272-8939-570a-a48d-ed27e11382b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE19037',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 59299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-26',
 'seller_name': None,
 'title': 'Fiat 500 1.3 M-Jet Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2015}
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE19037%27 HTTP/1.1" 200 None
2026-03-30 09:09:16 [auto1.it] INFO: Saving data for CE19037: {'auction_closing_time': 1774970047.0, 'created_time': 1774361313.236543, 'last_price_update_time': 1774861756.661053}
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CE19037') HTTP/1.1" 204 0
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: LC22701
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: BX20642
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: VZ29537
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ29537%27 HTTP/1.1" 200 None
2026-03-30 09:09:16 [auto1.it] INFO: Scrape type for VZ29537: 1
2026-03-30 09:09:16 [auto1.it] INFO: Found listing with ID: LS03457
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS03457%27 HTTP/1.1" 200 None
2026-03-30 09:09:16 [auto1.it] INFO: Scrape type for LS03457: 2
2026-03-30 09:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9a4757b-da20-5ee1-884d-5b6fa0197a4f with identifier: LS03457
2026-03-30 09:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a4757b-da20-5ee1-884d-5b6fa0197a4f with scrape type 2
2026-03-30 09:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9a4757b-da20-5ee1-884d-5b6fa0197a4f with scrape type 2
2026-03-30 09:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c9a4757b-da20-5ee1-884d-5b6fa0197a4f, identifier: LS03457
2026-03-30 09:09:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1376b10>
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_705284614cf13ee53883e791ddef7e25.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_705284614cf13ee53883e791ddef7e25.jpg saved to cache
2026-03-30 09:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48d74d0>
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_202c1267f8d0fef8881e7a382ae84628.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_202c1267f8d0fef8881e7a382ae84628.jpg saved to cache
2026-03-30 09:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21fa1551-09ac-5403-9288-f1583e434852
2026-03-30 09:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1273b10>
2026-03-30 09:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_3123b57b7741249c3fd1feeeec699cdd.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_3123b57b7741249c3fd1feeeec699cdd.jpg saved to cache
2026-03-30 09:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21fa1551-09ac-5403-9288-f1583e434852
2026-03-30 09:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_2e140f3352a83baca945e72e581e640a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c9a4757b-da20-5ee1-884d-5b6fa0197a4f with identifier: LS03457
2026-03-30 09:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c9a4757b-da20-5ee1-884d-5b6fa0197a4f with identifier: LS03457
2026-03-30 09:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c9a4757b-da20-5ee1-884d-5b6fa0197a4f with identifier: LS03457 to the API
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-31T15:55:12Z',
 'fuel_type': 'petrol',
 'id': 'c9a4757b-da20-5ee1-884d-5b6fa0197a4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS03457',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 98407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-31',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Turbo R-Dynamic',
 'transmission': 'automatic',
 'trim': 'R-Dynamic',
 'year': 2019}
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS03457%27 HTTP/1.1" 200 None
2026-03-30 09:09:17 [auto1.it] INFO: Saving data for LS03457: {'auction_closing_time': 1774972512.0, 'created_time': 1774447549.665053, 'last_price_update_time': 1774861757.486393}
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LS03457') HTTP/1.1" 204 0
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: RX33676
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: AX27463
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: CD12449
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: JZ26894
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: MB91559
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB91559%27 HTTP/1.1" 200 None
2026-03-30 09:09:17 [auto1.it] INFO: Scrape type for MB91559: 2
2026-03-30 09:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65ca629b-700c-5db0-bc90-1c02e9813c04 with identifier: MB91559
2026-03-30 09:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ca629b-700c-5db0-bc90-1c02e9813c04 with scrape type 2
2026-03-30 09:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65ca629b-700c-5db0-bc90-1c02e9813c04 with scrape type 2
2026-03-30 09:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 65ca629b-700c-5db0-bc90-1c02e9813c04, identifier: MB91559
2026-03-30 09:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: BV26472
2026-03-30 09:09:17 [auto1.it] INFO: Found listing with ID: PS14432
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS14432%27 HTTP/1.1" 200 None
2026-03-30 09:09:17 [auto1.it] INFO: Scrape type for PS14432: 2
2026-03-30 09:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed79cf56-46ab-5589-9c20-dc0e2c8c2fe6 with identifier: PS14432
2026-03-30 09:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed79cf56-46ab-5589-9c20-dc0e2c8c2fe6 with scrape type 2
2026-03-30 09:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed79cf56-46ab-5589-9c20-dc0e2c8c2fe6 with scrape type 2
2026-03-30 09:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ed79cf56-46ab-5589-9c20-dc0e2c8c2fe6, identifier: PS14432
2026-03-30 09:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 65ca629b-700c-5db0-bc90-1c02e9813c04 with identifier: MB91559
2026-03-30 09:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 65ca629b-700c-5db0-bc90-1c02e9813c04 with identifier: MB91559
2026-03-30 09:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 65ca629b-700c-5db0-bc90-1c02e9813c04 with identifier: MB91559 to the API
2026-03-30 09:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:18:08Z',
 'fuel_type': 'diesel',
 'id': '65ca629b-700c-5db0-bc90-1c02e9813c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB91559',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 143630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-25',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport D165 Mild-Hybrid R-Dynamic AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic AWD',
 'year': 2022}
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB91559%27 HTTP/1.1" 200 None
2026-03-30 09:09:19 [auto1.it] INFO: Saving data for MB91559: {'auction_closing_time': 1774970288.0, 'created_time': 1774645756.038117, 'last_price_update_time': 1774861759.688863}
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MB91559') HTTP/1.1" 204 0
2026-03-30 09:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24fb090>
2026-03-30 09:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_88161da93636083280903fb6a1ac6c92.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_88161da93636083280903fb6a1ac6c92.jpg saved to cache
2026-03-30 09:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564
2026-03-30 09:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1413750>
2026-03-30 09:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Ff5%252F4df54ea22d5b819a6f383fc5f7ebecdb%252Fpa%252FNG07362_b2d7dc17bb35db95cdc6fa216f76536a.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_b2d7dc17bb35db95cdc6fa216f76536a.jpg saved to cache
2026-03-30 09:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564
2026-03-30 09:09:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1bd5340a-5c83-5f99-bad1-d1d4e1b93564, skipping ID generation
2026-03-30 09:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564 with scrape type 1
2026-03-30 09:09:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1bd5340a-5c83-5f99-bad1-d1d4e1b93564 sending to next pipeline
2026-03-30 09:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1bd5340a-5c83-5f99-bad1-d1d4e1b93564, identifier: NG07362
2026-03-30 09:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ed79cf56-46ab-5589-9c20-dc0e2c8c2fe6 with identifier: PS14432
2026-03-30 09:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ed79cf56-46ab-5589-9c20-dc0e2c8c2fe6 with identifier: PS14432
2026-03-30 09:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ed79cf56-46ab-5589-9c20-dc0e2c8c2fe6 with identifier: PS14432 to the API
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:31:52Z',
 'fuel_type': 'diesel',
 'id': 'ed79cf56-46ab-5589-9c20-dc0e2c8c2fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS14432',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 72521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-22',
 'seller_name': None,
 'title': 'BMW 3er 318d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2016}
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS14432%27 HTTP/1.1" 200 None
2026-03-30 09:09:20 [auto1.it] INFO: Saving data for PS14432: {'auction_closing_time': 1774971112.0, 'created_time': 1773436379.342746, 'last_price_update_time': 1774861760.658586}
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PS14432') HTTP/1.1" 204 0
2026-03-30 09:09:20 [auto1.it] INFO: Found listing with ID: WT68186
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT68186%27 HTTP/1.1" 200 None
2026-03-30 09:09:20 [auto1.it] INFO: Scrape type for WT68186: 2
2026-03-30 09:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85537b88-dd3b-5682-a2e7-546959c92c64 with identifier: WT68186
2026-03-30 09:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85537b88-dd3b-5682-a2e7-546959c92c64 with scrape type 2
2026-03-30 09:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85537b88-dd3b-5682-a2e7-546959c92c64 with scrape type 2
2026-03-30 09:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 85537b88-dd3b-5682-a2e7-546959c92c64, identifier: WT68186
2026-03-30 09:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1bd5340a-5c83-5f99-bad1-d1d4e1b93564 with identifier: NG07362
2026-03-30 09:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1bd5340a-5c83-5f99-bad1-d1d4e1b93564 with identifier: NG07362
2026-03-30 09:09:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1bd5340a-5c83-5f99-bad1-d1d4e1b93564 with identifier: NG07362 to the API
2026-03-30 09:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_b2d7dc17bb35db95cdc6fa216f76536a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:14:43Z',
 'fuel_type': 'petrol',
 'id': '1bd5340a-5c83-5f99-bad1-d1d4e1b93564',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG07362',
 'listing': 'auction',
 'location': 'IT, Fasano BR',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 478693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_e9c57b993f4154c064508183ed281094.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_deef4b3a97d5abe940115dd0738c546b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_b01d01c913f2114a28692b9231e568ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_0ebe6a53bf57e2503f67256d077e7d56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_ed7ed7492108d83ed43c0db4aa9468c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_cc3f4214bde41587f441b03c74259a18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_c648004e72158342c77fe98a0748a40f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_705284614cf13ee53883e791ddef7e25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_88161da93636083280903fb6a1ac6c92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd5340a-5c83-5f99-bad1-d1d4e1b93564/1bd5340a-5c83-5f99-bad1-d1d4e1b93564_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/f5/4df54ea22d5b819a6f383fc5f7ebecdb/pa/NG07362_b2d7dc17bb35db95cdc6fa216f76536a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2018}
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG07362%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Saving data for NG07362: {'created_time': 1774861761.248511, 'last_price_update_time': 1774861761.248522, 'auction_closing_time': 1774970083.0}
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NG07362') HTTP/1.1" 204 0
2026-03-30 09:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_a3e61408a2f5051d77153cc742edba6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: SZ24732
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: PR58597
2026-03-30 09:09:21 [auto1.it] INFO: Found listing with ID: ME44881
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME44881%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Scrape type for ME44881: 2
2026-03-30 09:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c48a181b-56d9-5905-a5ce-9e8430ac2193 with identifier: ME44881
2026-03-30 09:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c48a181b-56d9-5905-a5ce-9e8430ac2193 with scrape type 2
2026-03-30 09:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c48a181b-56d9-5905-a5ce-9e8430ac2193 with scrape type 2
2026-03-30 09:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c48a181b-56d9-5905-a5ce-9e8430ac2193, identifier: ME44881
2026-03-30 09:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 85537b88-dd3b-5682-a2e7-546959c92c64 with identifier: WT68186
2026-03-30 09:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 85537b88-dd3b-5682-a2e7-546959c92c64 with identifier: WT68186
2026-03-30 09:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 85537b88-dd3b-5682-a2e7-546959c92c64 with identifier: WT68186 to the API
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:22:10Z',
 'fuel_type': 'petrol',
 'id': '85537b88-dd3b-5682-a2e7-546959c92c64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT68186',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 124768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT68186%27 HTTP/1.1" 200 None
2026-03-30 09:09:21 [auto1.it] INFO: Saving data for WT68186: {'auction_closing_time': 1774970530.0, 'created_time': 1773479190.313304, 'last_price_update_time': 1774861761.751901}
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WT68186') HTTP/1.1" 204 0
2026-03-30 09:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1293590>
2026-03-30 09:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_2e140f3352a83baca945e72e581e640a.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_2e140f3352a83baca945e72e581e640a.jpg saved to cache
2026-03-30 09:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21fa1551-09ac-5403-9288-f1583e434852
2026-03-30 09:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c48a181b-56d9-5905-a5ce-9e8430ac2193 with identifier: ME44881
2026-03-30 09:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c48a181b-56d9-5905-a5ce-9e8430ac2193 with identifier: ME44881
2026-03-30 09:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c48a181b-56d9-5905-a5ce-9e8430ac2193 with identifier: ME44881 to the API
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-31T15:19:55Z',
 'fuel_type': 'petrol',
 'id': 'c48a181b-56d9-5905-a5ce-9e8430ac2193',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME44881',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Grecale',
 'odometer': 57808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-27',
 'seller_name': None,
 'title': 'Maserati Grecale 2.0 Turbo Mild-Hybrid GT AWD',
 'transmission': 'automatic',
 'trim': 'GT AWD',
 'year': 2023}
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME44881%27 HTTP/1.1" 200 None
2026-03-30 09:09:22 [auto1.it] INFO: Saving data for ME44881: {'auction_closing_time': 1774970395.0, 'created_time': 1774386406.273259, 'last_price_update_time': 1774861762.428633}
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ME44881') HTTP/1.1" 204 0
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: ZB83520
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB83520%27 HTTP/1.1" 200 None
2026-03-30 09:09:22 [auto1.it] INFO: Scrape type for ZB83520: 2
2026-03-30 09:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9ed7eb0-3fcc-54ab-881b-0eab17da735a with identifier: ZB83520
2026-03-30 09:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9ed7eb0-3fcc-54ab-881b-0eab17da735a with scrape type 2
2026-03-30 09:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9ed7eb0-3fcc-54ab-881b-0eab17da735a with scrape type 2
2026-03-30 09:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e9ed7eb0-3fcc-54ab-881b-0eab17da735a, identifier: ZB83520
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: VV47439
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: JL83734
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: SP39094
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: LC22701
2026-03-30 09:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e9ed7eb0-3fcc-54ab-881b-0eab17da735a with identifier: ZB83520
2026-03-30 09:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e9ed7eb0-3fcc-54ab-881b-0eab17da735a with identifier: ZB83520
2026-03-30 09:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e9ed7eb0-3fcc-54ab-881b-0eab17da735a with identifier: ZB83520 to the API
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:07:50Z',
 'fuel_type': 'diesel',
 'id': 'e9ed7eb0-3fcc-54ab-881b-0eab17da735a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB83520',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 186818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-16',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2015}
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB83520%27 HTTP/1.1" 200 None
2026-03-30 09:09:22 [auto1.it] INFO: Saving data for ZB83520: {'auction_closing_time': 1774969670.0, 'created_time': 1774354419.550726, 'last_price_update_time': 1774861762.959674}
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZB83520') HTTP/1.1" 204 0
2026-03-30 09:09:22 [auto1.it] INFO: Found listing with ID: JR03068
2026-03-30 09:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR03068%27 HTTP/1.1" 200 None
2026-03-30 09:09:23 [auto1.it] INFO: Scrape type for JR03068: 2
2026-03-30 09:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 459fc97e-09b5-5620-96fe-91c8c8f64e26 with identifier: JR03068
2026-03-30 09:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 459fc97e-09b5-5620-96fe-91c8c8f64e26 with scrape type 2
2026-03-30 09:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 459fc97e-09b5-5620-96fe-91c8c8f64e26 with scrape type 2
2026-03-30 09:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 459fc97e-09b5-5620-96fe-91c8c8f64e26, identifier: JR03068
2026-03-30 09:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24e1950>
2026-03-30 09:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_a3e61408a2f5051d77153cc742edba6d.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_a3e61408a2f5051d77153cc742edba6d.jpg saved to cache
2026-03-30 09:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21fa1551-09ac-5403-9288-f1583e434852
2026-03-30 09:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 459fc97e-09b5-5620-96fe-91c8c8f64e26 with identifier: JR03068
2026-03-30 09:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 459fc97e-09b5-5620-96fe-91c8c8f64e26 with identifier: JR03068
2026-03-30 09:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 459fc97e-09b5-5620-96fe-91c8c8f64e26 with identifier: JR03068 to the API
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:18:10Z',
 'fuel_type': 'petrol',
 'id': '459fc97e-09b5-5620-96fe-91c8c8f64e26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR03068',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 240209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 BIFuel Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2010}
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR03068%27 HTTP/1.1" 200 None
2026-03-30 09:09:23 [auto1.it] INFO: Saving data for JR03068: {'auction_closing_time': 1774970290.0, 'created_time': 1774386522.31252, 'last_price_update_time': 1774861763.507124}
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JR03068') HTTP/1.1" 204 0
2026-03-30 09:09:23 [auto1.it] INFO: Found listing with ID: UN95232
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN95232%27 HTTP/1.1" 200 None
2026-03-30 09:09:23 [auto1.it] INFO: Scrape type for UN95232: 2
2026-03-30 09:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99f4400-0570-595f-9136-45ee32299e36 with identifier: UN95232
2026-03-30 09:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99f4400-0570-595f-9136-45ee32299e36 with scrape type 2
2026-03-30 09:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c99f4400-0570-595f-9136-45ee32299e36 with scrape type 2
2026-03-30 09:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c99f4400-0570-595f-9136-45ee32299e36, identifier: UN95232
2026-03-30 09:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c99f4400-0570-595f-9136-45ee32299e36 with identifier: UN95232
2026-03-30 09:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c99f4400-0570-595f-9136-45ee32299e36 with identifier: UN95232
2026-03-30 09:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c99f4400-0570-595f-9136-45ee32299e36 with identifier: UN95232 to the API
2026-03-30 09:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:51:16Z',
 'fuel_type': 'diesel',
 'id': 'c99f4400-0570-595f-9136-45ee32299e36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN95232',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 80673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-31',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2012}
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN95232%27 HTTP/1.1" 200 None
2026-03-30 09:09:24 [auto1.it] INFO: Saving data for UN95232: {'auction_closing_time': 1774972276.0, 'created_time': 1773241893.922864, 'last_price_update_time': 1774861764.310817}
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UN95232') HTTP/1.1" 204 0
2026-03-30 09:09:24 [auto1.it] INFO: Found listing with ID: LY05485
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY05485%27 HTTP/1.1" 200 None
2026-03-30 09:09:24 [auto1.it] INFO: Scrape type for LY05485: 2
2026-03-30 09:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01450bfc-6c2d-598a-a798-555538101f10 with identifier: LY05485
2026-03-30 09:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01450bfc-6c2d-598a-a798-555538101f10 with scrape type 2
2026-03-30 09:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01450bfc-6c2d-598a-a798-555538101f10 with scrape type 2
2026-03-30 09:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 01450bfc-6c2d-598a-a798-555538101f10, identifier: LY05485
2026-03-30 09:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 01450bfc-6c2d-598a-a798-555538101f10 with identifier: LY05485
2026-03-30 09:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 01450bfc-6c2d-598a-a798-555538101f10 with identifier: LY05485
2026-03-30 09:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 01450bfc-6c2d-598a-a798-555538101f10 with identifier: LY05485 to the API
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:36:28Z',
 'fuel_type': 'petrol',
 'id': '01450bfc-6c2d-598a-a798-555538101f10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY05485',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 178918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-03',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY05485%27 HTTP/1.1" 200 None
2026-03-30 09:09:24 [auto1.it] INFO: Saving data for LY05485: {'auction_closing_time': 1774971388.0, 'created_time': 1773236763.72951, 'last_price_update_time': 1774861764.821849}
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY05485') HTTP/1.1" 204 0
2026-03-30 09:09:24 [auto1.it] INFO: Found listing with ID: PF40120
2026-03-30 09:09:24 [auto1.it] INFO: Found listing with ID: PV06948
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV06948%27 HTTP/1.1" 200 None
2026-03-30 09:09:24 [auto1.it] INFO: Scrape type for PV06948: 2
2026-03-30 09:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f37c816-a7e9-543e-9b5c-29bbf98e7748 with identifier: PV06948
2026-03-30 09:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f37c816-a7e9-543e-9b5c-29bbf98e7748 with scrape type 2
2026-03-30 09:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f37c816-a7e9-543e-9b5c-29bbf98e7748 with scrape type 2
2026-03-30 09:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f37c816-a7e9-543e-9b5c-29bbf98e7748, identifier: PV06948
2026-03-30 09:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f37c816-a7e9-543e-9b5c-29bbf98e7748 with identifier: PV06948
2026-03-30 09:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f37c816-a7e9-543e-9b5c-29bbf98e7748 with identifier: PV06948
2026-03-30 09:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f37c816-a7e9-543e-9b5c-29bbf98e7748 with identifier: PV06948 to the API
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:43:43Z',
 'fuel_type': 'petrol',
 'id': '7f37c816-a7e9-543e-9b5c-29bbf98e7748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV06948',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 197716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-13',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Pinko',
 'transmission': 'manual',
 'trim': 'Pinko',
 'year': 2007}
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV06948%27 HTTP/1.1" 200 None
2026-03-30 09:09:25 [auto1.it] INFO: Saving data for PV06948: {'auction_closing_time': 1774971823.0, 'created_time': 1773675264.482643, 'last_price_update_time': 1774861765.281831}
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV06948') HTTP/1.1" 204 0
2026-03-30 09:09:25 [auto1.it] INFO: Found listing with ID: LS46243
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS46243%27 HTTP/1.1" 200 None
2026-03-30 09:09:25 [auto1.it] INFO: Scrape type for LS46243: 1
2026-03-30 09:09:25 [auto1.it] INFO: Found listing with ID: WV48837
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV48837%27 HTTP/1.1" 200 None
2026-03-30 09:09:25 [auto1.it] INFO: Scrape type for WV48837: 1
2026-03-30 09:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:25 [auto1.it] INFO: Found listing with ID: DC26053
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC26053%27 HTTP/1.1" 200 None
2026-03-30 09:09:25 [auto1.it] INFO: Scrape type for DC26053: 2
2026-03-30 09:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f52e5f6-4bf4-53c1-93a9-fcd2f68f084e with identifier: DC26053
2026-03-30 09:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f52e5f6-4bf4-53c1-93a9-fcd2f68f084e with scrape type 2
2026-03-30 09:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f52e5f6-4bf4-53c1-93a9-fcd2f68f084e with scrape type 2
2026-03-30 09:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f52e5f6-4bf4-53c1-93a9-fcd2f68f084e, identifier: DC26053
2026-03-30 09:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f52e5f6-4bf4-53c1-93a9-fcd2f68f084e with identifier: DC26053
2026-03-30 09:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f52e5f6-4bf4-53c1-93a9-fcd2f68f084e with identifier: DC26053
2026-03-30 09:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f52e5f6-4bf4-53c1-93a9-fcd2f68f084e with identifier: DC26053 to the API
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:25:32Z',
 'fuel_type': 'diesel',
 'id': '7f52e5f6-4bf4-53c1-93a9-fcd2f68f084e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC26053',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 177240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-18',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exceed 4WD',
 'transmission': 'manual',
 'trim': 'Exceed 4WD',
 'year': 2013}
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC26053%27 HTTP/1.1" 200 None
2026-03-30 09:09:25 [auto1.it] INFO: Saving data for DC26053: {'auction_closing_time': 1774970732.0, 'created_time': 1773489976.004593, 'last_price_update_time': 1774861765.879808}
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DC26053') HTTP/1.1" 204 0
2026-03-30 09:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:26 [auto1.it] INFO: Found listing with ID: VP93910
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP93910%27 HTTP/1.1" 200 None
2026-03-30 09:09:26 [auto1.it] INFO: Scrape type for VP93910: 2
2026-03-30 09:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b11a41a9-e7de-55dd-a3dc-34702b8ee1c6 with identifier: VP93910
2026-03-30 09:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b11a41a9-e7de-55dd-a3dc-34702b8ee1c6 with scrape type 2
2026-03-30 09:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b11a41a9-e7de-55dd-a3dc-34702b8ee1c6 with scrape type 2
2026-03-30 09:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b11a41a9-e7de-55dd-a3dc-34702b8ee1c6, identifier: VP93910
2026-03-30 09:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b11a41a9-e7de-55dd-a3dc-34702b8ee1c6 with identifier: VP93910
2026-03-30 09:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b11a41a9-e7de-55dd-a3dc-34702b8ee1c6 with identifier: VP93910
2026-03-30 09:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b11a41a9-e7de-55dd-a3dc-34702b8ee1c6 with identifier: VP93910 to the API
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:35:05Z',
 'fuel_type': 'petrol',
 'id': 'b11a41a9-e7de-55dd-a3dc-34702b8ee1c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP93910',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 90772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-22',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 Ego ecoFlex',
 'transmission': 'manual',
 'trim': 'Ego ecoFlex',
 'year': 2014}
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP93910%27 HTTP/1.1" 200 None
2026-03-30 09:09:26 [auto1.it] INFO: Saving data for VP93910: {'auction_closing_time': 1774971305.0, 'created_time': 1774354134.154803, 'last_price_update_time': 1774861766.521611}
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VP93910') HTTP/1.1" 204 0
2026-03-30 09:09:26 [auto1.it] INFO: Found listing with ID: JZ95441
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ95441%27 HTTP/1.1" 200 None
2026-03-30 09:09:26 [auto1.it] INFO: Scrape type for JZ95441: 2
2026-03-30 09:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55d7905-8e0b-5a8a-b47c-fd0868c059a1 with identifier: JZ95441
2026-03-30 09:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55d7905-8e0b-5a8a-b47c-fd0868c059a1 with scrape type 2
2026-03-30 09:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e55d7905-8e0b-5a8a-b47c-fd0868c059a1 with scrape type 2
2026-03-30 09:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e55d7905-8e0b-5a8a-b47c-fd0868c059a1, identifier: JZ95441
2026-03-30 09:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ29537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV22884> (referer: https://www.auto1.com/v1/car-details-view/JV22884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e55d7905-8e0b-5a8a-b47c-fd0868c059a1 with identifier: JZ95441
2026-03-30 09:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e55d7905-8e0b-5a8a-b47c-fd0868c059a1 with identifier: JZ95441
2026-03-30 09:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e55d7905-8e0b-5a8a-b47c-fd0868c059a1 with identifier: JZ95441 to the API
2026-03-30 09:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-31T15:51:07Z',
 'fuel_type': 'petrol',
 'id': 'e55d7905-8e0b-5a8a-b47c-fd0868c059a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ95441',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 233070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ95441%27 HTTP/1.1" 200 None
2026-03-30 09:09:27 [auto1.it] INFO: Saving data for JZ95441: {'auction_closing_time': 1774972267.0, 'created_time': 1773236750.245498, 'last_price_update_time': 1774861767.580578}
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ95441') HTTP/1.1" 204 0
2026-03-30 09:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:27 [auto1.it] INFO: Found listing with ID: DR82900
2026-03-30 09:09:27 [auto1.it] INFO: Found listing with ID: WH56731
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH56731%27 HTTP/1.1" 200 None
2026-03-30 09:09:27 [auto1.it] INFO: Scrape type for WH56731: 2
2026-03-30 09:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 933313da-5f62-5b45-86ca-858c25c50623 with identifier: WH56731
2026-03-30 09:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 933313da-5f62-5b45-86ca-858c25c50623 with scrape type 2
2026-03-30 09:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 933313da-5f62-5b45-86ca-858c25c50623 with scrape type 2
2026-03-30 09:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 933313da-5f62-5b45-86ca-858c25c50623, identifier: WH56731
2026-03-30 09:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_4c9e0949a8bd4351f1314207d4711514.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 933313da-5f62-5b45-86ca-858c25c50623 with identifier: WH56731
2026-03-30 09:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 933313da-5f62-5b45-86ca-858c25c50623 with identifier: WH56731
2026-03-30 09:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 933313da-5f62-5b45-86ca-858c25c50623 with identifier: WH56731 to the API
2026-03-30 09:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:18:11Z',
 'fuel_type': 'diesel',
 'id': '933313da-5f62-5b45-86ca-858c25c50623',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH56731',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 101321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2020}
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH56731%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Saving data for WH56731: {'auction_closing_time': 1774970291.0, 'created_time': 1774440363.353691, 'last_price_update_time': 1774861768.160787}
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WH56731') HTTP/1.1" 204 0
2026-03-30 09:09:28 [auto1.it] INFO: Found listing with ID: FN72071
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN72071%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Scrape type for FN72071: 2
2026-03-30 09:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5765bad8-06f9-5edc-8129-887ee847a2a7 with identifier: FN72071
2026-03-30 09:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5765bad8-06f9-5edc-8129-887ee847a2a7 with scrape type 2
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5765bad8-06f9-5edc-8129-887ee847a2a7 with scrape type 2
2026-03-30 09:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5765bad8-06f9-5edc-8129-887ee847a2a7, identifier: FN72071
2026-03-30 09:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5765bad8-06f9-5edc-8129-887ee847a2a7 with identifier: FN72071
2026-03-30 09:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5765bad8-06f9-5edc-8129-887ee847a2a7 with identifier: FN72071
2026-03-30 09:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5765bad8-06f9-5edc-8129-887ee847a2a7 with identifier: FN72071 to the API
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:07:56Z',
 'fuel_type': 'diesel',
 'id': '5765bad8-06f9-5edc-8129-887ee847a2a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN72071',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 189983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-11',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2013}
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN72071%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [auto1.it] INFO: Saving data for FN72071: {'auction_closing_time': 1774969676.0, 'created_time': 1773954335.341315, 'last_price_update_time': 1774861768.657491}
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FN72071') HTTP/1.1" 204 0
2026-03-30 09:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e39495df-9352-5393-a5d9-0752bbeeafab with identifier: JV22884
2026-03-30 09:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e39495df-9352-5393-a5d9-0752bbeeafab with scrape type 1
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F72%252F5e72535ff4b47b92ff6651048be9a273%252Fpa%252FJV22884_5e3a421a2606567b52ae705235b05452.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_5e3a421a2606567b52ae705235b05452.jpg already downloaded
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F72%252F5e72535ff4b47b92ff6651048be9a273%252Fpa%252FJV22884_3e9a948ff71edfa3540b7c9aecd09932.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_3e9a948ff71edfa3540b7c9aecd09932.jpg already downloaded
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F72%252F5e72535ff4b47b92ff6651048be9a273%252Fpa%252FJV22884_e52febbf4d365fc45f9168fcb7e2e708.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_e52febbf4d365fc45f9168fcb7e2e708.jpg already downloaded
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F72%252F5e72535ff4b47b92ff6651048be9a273%252Fpa%252FJV22884_b49c9d4c50bb74bd605d1d82bf419f83.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b49c9d4c50bb74bd605d1d82bf419f83.jpg already downloaded
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F72%252F5e72535ff4b47b92ff6651048be9a273%252Fpa%252FJV22884_a2bc62e4676e826a1db67eebb30a8129.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a2bc62e4676e826a1db67eebb30a8129.jpg already downloaded
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F72%252F5e72535ff4b47b92ff6651048be9a273%252Fpa%252FJV22884_45c7f4975dc0cfadd35b75f907b8aaff.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_45c7f4975dc0cfadd35b75f907b8aaff.jpg already downloaded
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F72%252F5e72535ff4b47b92ff6651048be9a273%252Fpa%252FJV22884_67c1deff2f544507c2a1e1e3ccdc2001.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_67c1deff2f544507c2a1e1e3ccdc2001.jpg already downloaded
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F72%252F5e72535ff4b47b92ff6651048be9a273%252Fpa%252FJV22884_61371bdec99a54d5af652cf7d03a570a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_61371bdec99a54d5af652cf7d03a570a.jpg already downloaded
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F72%252F5e72535ff4b47b92ff6651048be9a273%252Fpa%252FJV22884_b387641376517c73b70a96867dfdf55a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b387641376517c73b70a96867dfdf55a.jpg already downloaded
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F72%252F5e72535ff4b47b92ff6651048be9a273%252Fpa%252FJV22884_a811619db39104463157ba525984a1bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a811619db39104463157ba525984a1bf.jpg already downloaded
2026-03-30 09:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e39495df-9352-5393-a5d9-0752bbeeafab, identifier: JV22884
2026-03-30 09:09:28 [auto1.it] INFO: Channel: 24h | Page: 16 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:29 [auto1.it] INFO: Found listing with ID: YN65512
2026-03-30 09:09:29 [auto1.it] INFO: Found listing with ID: PB31965
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB31965%27 HTTP/1.1" 200 None
2026-03-30 09:09:29 [auto1.it] INFO: Scrape type for PB31965: 2
2026-03-30 09:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a79462b-ce14-59fa-8017-a4d4a1a43b61 with identifier: PB31965
2026-03-30 09:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a79462b-ce14-59fa-8017-a4d4a1a43b61 with scrape type 2
2026-03-30 09:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a79462b-ce14-59fa-8017-a4d4a1a43b61 with scrape type 2
2026-03-30 09:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1a79462b-ce14-59fa-8017-a4d4a1a43b61, identifier: PB31965
2026-03-30 09:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e39495df-9352-5393-a5d9-0752bbeeafab with identifier: JV22884
2026-03-30 09:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e39495df-9352-5393-a5d9-0752bbeeafab with identifier: JV22884
2026-03-30 09:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e39495df-9352-5393-a5d9-0752bbeeafab with identifier: JV22884 to the API
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JV22884>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:20:51Z',
 'fuel_type': 'diesel',
 'id': 'e39495df-9352-5393-a5d9-0752bbeeafab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV22884',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 99900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_5e3a421a2606567b52ae705235b05452.jpg',
                'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_3e9a948ff71edfa3540b7c9aecd09932.jpg',
                'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_e52febbf4d365fc45f9168fcb7e2e708.jpg',
                'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b49c9d4c50bb74bd605d1d82bf419f83.jpg',
                'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a2bc62e4676e826a1db67eebb30a8129.jpg',
                'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_45c7f4975dc0cfadd35b75f907b8aaff.jpg',
                'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_67c1deff2f544507c2a1e1e3ccdc2001.jpg',
                'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_61371bdec99a54d5af652cf7d03a570a.jpg',
                'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b387641376517c73b70a96867dfdf55a.jpg',
                'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a811619db39104463157ba525984a1bf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_5e3a421a2606567b52ae705235b05452.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_3e9a948ff71edfa3540b7c9aecd09932.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_e52febbf4d365fc45f9168fcb7e2e708.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b49c9d4c50bb74bd605d1d82bf419f83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a2bc62e4676e826a1db67eebb30a8129.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_45c7f4975dc0cfadd35b75f907b8aaff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_67c1deff2f544507c2a1e1e3ccdc2001.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_61371bdec99a54d5af652cf7d03a570a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b387641376517c73b70a96867dfdf55a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a811619db39104463157ba525984a1bf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500L 1.3 JTD Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2014}
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV22884%27 HTTP/1.1" 200 None
2026-03-30 09:09:29 [auto1.it] INFO: Saving data for JV22884: {'created_time': 1774861769.432537, 'last_price_update_time': 1774861769.432549, 'auction_closing_time': 1774970451.0}
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JV22884') HTTP/1.1" 204 0
2026-03-30 09:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1a79462b-ce14-59fa-8017-a4d4a1a43b61 with identifier: PB31965
2026-03-30 09:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1a79462b-ce14-59fa-8017-a4d4a1a43b61 with identifier: PB31965
2026-03-30 09:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1a79462b-ce14-59fa-8017-a4d4a1a43b61 with identifier: PB31965 to the API
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:25:41Z',
 'fuel_type': 'petrol',
 'id': '1a79462b-ce14-59fa-8017-a4d4a1a43b61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB31965',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 3272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-29',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Rip Curl',
 'transmission': 'automatic',
 'trim': 'Rip Curl',
 'year': 2023}
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB31965%27 HTTP/1.1" 200 None
2026-03-30 09:09:29 [auto1.it] INFO: Saving data for PB31965: {'auction_closing_time': 1774970741.0, 'created_time': 1774472824.200074, 'last_price_update_time': 1774861769.758065}
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PB31965') HTTP/1.1" 204 0
2026-03-30 09:09:29 [auto1.it] INFO: Found listing with ID: NA96528
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA96528%27 HTTP/1.1" 200 None
2026-03-30 09:09:29 [auto1.it] INFO: Scrape type for NA96528: 2
2026-03-30 09:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8be040a1-dab5-5f66-b9ef-6921999a950d with identifier: NA96528
2026-03-30 09:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be040a1-dab5-5f66-b9ef-6921999a950d with scrape type 2
2026-03-30 09:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8be040a1-dab5-5f66-b9ef-6921999a950d with scrape type 2
2026-03-30 09:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8be040a1-dab5-5f66-b9ef-6921999a950d, identifier: NA96528
2026-03-30 09:09:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2559f50>
2026-03-30 09:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_4c9e0949a8bd4351f1314207d4711514.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_4c9e0949a8bd4351f1314207d4711514.jpg saved to cache
2026-03-30 09:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21fa1551-09ac-5403-9288-f1583e434852
2026-03-30 09:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_d6572085ffcb1d220bd29c62bbb77643.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_23d730db80401224f098316622a2c22a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:30 [auto1.it] INFO: Found listing with ID: MB79295
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB79295%27 HTTP/1.1" 200 None
2026-03-30 09:09:30 [auto1.it] INFO: Scrape type for MB79295: 2
2026-03-30 09:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 201eeecd-b07d-5606-8ace-782a7e21a59f with identifier: MB79295
2026-03-30 09:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 201eeecd-b07d-5606-8ace-782a7e21a59f with scrape type 2
2026-03-30 09:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 201eeecd-b07d-5606-8ace-782a7e21a59f with scrape type 2
2026-03-30 09:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 201eeecd-b07d-5606-8ace-782a7e21a59f, identifier: MB79295
2026-03-30 09:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8be040a1-dab5-5f66-b9ef-6921999a950d with identifier: NA96528
2026-03-30 09:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8be040a1-dab5-5f66-b9ef-6921999a950d with identifier: NA96528
2026-03-30 09:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8be040a1-dab5-5f66-b9ef-6921999a950d with identifier: NA96528 to the API
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:52:42Z',
 'fuel_type': 'petrol',
 'id': '8be040a1-dab5-5f66-b9ef-6921999a950d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA96528',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 156529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-24',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2008}
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA96528%27 HTTP/1.1" 200 None
2026-03-30 09:09:30 [auto1.it] INFO: Saving data for NA96528: {'auction_closing_time': 1774972362.0, 'created_time': 1774353976.551645, 'last_price_update_time': 1774861770.504484}
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NA96528') HTTP/1.1" 204 0
2026-03-30 09:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 201eeecd-b07d-5606-8ace-782a7e21a59f with identifier: MB79295
2026-03-30 09:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 201eeecd-b07d-5606-8ace-782a7e21a59f with identifier: MB79295
2026-03-30 09:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 201eeecd-b07d-5606-8ace-782a7e21a59f with identifier: MB79295 to the API
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:11:45Z',
 'fuel_type': 'diesel',
 'id': '201eeecd-b07d-5606-8ace-782a7e21a59f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB79295',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 53468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-19',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 M-Jet Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2022}
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB79295%27 HTTP/1.1" 200 None
2026-03-30 09:09:31 [auto1.it] INFO: Saving data for MB79295: {'auction_closing_time': 1774969905.0, 'created_time': 1773267448.977186, 'last_price_update_time': 1774861771.351513}
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MB79295') HTTP/1.1" 204 0
2026-03-30 09:09:31 [auto1.it] INFO: Found listing with ID: JU96754
2026-03-30 09:09:31 [auto1.it] INFO: Found listing with ID: DU75203
2026-03-30 09:09:31 [auto1.it] INFO: Found listing with ID: PC80500
2026-03-30 09:09:31 [auto1.it] INFO: Found listing with ID: UH68033
2026-03-30 09:09:31 [auto1.it] INFO: Found listing with ID: RK56494
2026-03-30 09:09:31 [auto1.it] INFO: Found listing with ID: HB38869
2026-03-30 09:09:31 [auto1.it] INFO: Found listing with ID: WG31996
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG31996%27 HTTP/1.1" 200 None
2026-03-30 09:09:31 [auto1.it] INFO: Scrape type for WG31996: 2
2026-03-30 09:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 931a6ed2-3bc5-5b7c-ab0e-b301c9b96460 with identifier: WG31996
2026-03-30 09:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 931a6ed2-3bc5-5b7c-ab0e-b301c9b96460 with scrape type 2
2026-03-30 09:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 931a6ed2-3bc5-5b7c-ab0e-b301c9b96460 with scrape type 2
2026-03-30 09:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 931a6ed2-3bc5-5b7c-ab0e-b301c9b96460, identifier: WG31996
2026-03-30 09:09:31 [auto1.it] INFO: Found listing with ID: MD54154
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD54154%27 HTTP/1.1" 200 None
2026-03-30 09:09:31 [auto1.it] INFO: Scrape type for MD54154: 2
2026-03-30 09:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24850b58-e5fb-5df6-88af-5fe917dd7dc3 with identifier: MD54154
2026-03-30 09:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24850b58-e5fb-5df6-88af-5fe917dd7dc3 with scrape type 2
2026-03-30 09:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24850b58-e5fb-5df6-88af-5fe917dd7dc3 with scrape type 2
2026-03-30 09:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 24850b58-e5fb-5df6-88af-5fe917dd7dc3, identifier: MD54154
2026-03-30 09:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 931a6ed2-3bc5-5b7c-ab0e-b301c9b96460 with identifier: WG31996
2026-03-30 09:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 931a6ed2-3bc5-5b7c-ab0e-b301c9b96460 with identifier: WG31996
2026-03-30 09:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 931a6ed2-3bc5-5b7c-ab0e-b301c9b96460 with identifier: WG31996 to the API
2026-03-30 09:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:07:58Z',
 'fuel_type': 'diesel',
 'id': '931a6ed2-3bc5-5b7c-ab0e-b301c9b96460',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG31996',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 233079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-14',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 dCi Tekna 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna 4x4',
 'year': 2013}
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG31996%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Saving data for WG31996: {'auction_closing_time': 1774969678.0, 'created_time': 1773232938.415289, 'last_price_update_time': 1774861772.15266}
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WG31996') HTTP/1.1" 204 0
2026-03-30 09:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV48837/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 24850b58-e5fb-5df6-88af-5fe917dd7dc3 with identifier: MD54154
2026-03-30 09:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 24850b58-e5fb-5df6-88af-5fe917dd7dc3 with identifier: MD54154
2026-03-30 09:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 24850b58-e5fb-5df6-88af-5fe917dd7dc3 with identifier: MD54154 to the API
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:45:08Z',
 'fuel_type': 'diesel',
 'id': '24850b58-e5fb-5df6-88af-5fe917dd7dc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD54154',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 200981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2015}
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD54154%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Saving data for MD54154: {'auction_closing_time': 1774971908.0, 'created_time': 1772784398.900805, 'last_price_update_time': 1774861772.584821}
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MD54154') HTTP/1.1" 204 0
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: YN37563
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: LT20322
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT20322%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Scrape type for LT20322: 2
2026-03-30 09:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed2b7e2c-bd11-51a9-9876-1fcf981c40c5 with identifier: LT20322
2026-03-30 09:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed2b7e2c-bd11-51a9-9876-1fcf981c40c5 with scrape type 2
2026-03-30 09:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed2b7e2c-bd11-51a9-9876-1fcf981c40c5 with scrape type 2
2026-03-30 09:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ed2b7e2c-bd11-51a9-9876-1fcf981c40c5, identifier: LT20322
2026-03-30 09:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_17c4178fc738e96a552e3cd6051833f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: DD76151
2026-03-30 09:09:32 [auto1.it] INFO: Found listing with ID: XY70829
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY70829%27 HTTP/1.1" 200 None
2026-03-30 09:09:32 [auto1.it] INFO: Scrape type for XY70829: 2
2026-03-30 09:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcde946c-4bea-5138-a14e-f5e62acccaa6 with identifier: XY70829
2026-03-30 09:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcde946c-4bea-5138-a14e-f5e62acccaa6 with scrape type 2
2026-03-30 09:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcde946c-4bea-5138-a14e-f5e62acccaa6 with scrape type 2
2026-03-30 09:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dcde946c-4bea-5138-a14e-f5e62acccaa6, identifier: XY70829
2026-03-30 09:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ed2b7e2c-bd11-51a9-9876-1fcf981c40c5 with identifier: LT20322
2026-03-30 09:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ed2b7e2c-bd11-51a9-9876-1fcf981c40c5 with identifier: LT20322
2026-03-30 09:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ed2b7e2c-bd11-51a9-9876-1fcf981c40c5 with identifier: LT20322 to the API
2026-03-30 09:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:06:49Z',
 'fuel_type': 'petrol',
 'id': 'ed2b7e2c-bd11-51a9-9876-1fcf981c40c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT20322',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 229922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-04',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Active 2WD',
 'transmission': 'manual',
 'trim': 'Active 2WD',
 'year': 2010}
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT20322%27 HTTP/1.1" 200 None
2026-03-30 09:09:33 [auto1.it] INFO: Saving data for LT20322: {'auction_closing_time': 1774969609.0, 'created_time': 1774094755.833919, 'last_price_update_time': 1774861773.175288}
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LT20322') HTTP/1.1" 204 0
2026-03-30 09:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dcde946c-4bea-5138-a14e-f5e62acccaa6 with identifier: XY70829
2026-03-30 09:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dcde946c-4bea-5138-a14e-f5e62acccaa6 with identifier: XY70829
2026-03-30 09:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dcde946c-4bea-5138-a14e-f5e62acccaa6 with identifier: XY70829 to the API
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:00:09Z',
 'fuel_type': 'petrol',
 'id': 'dcde946c-4bea-5138-a14e-f5e62acccaa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY70829',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 113000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY70829%27 HTTP/1.1" 200 None
2026-03-30 09:09:33 [auto1.it] INFO: Saving data for XY70829: {'auction_closing_time': 1774969209.0, 'created_time': 1774354493.438867, 'last_price_update_time': 1774861773.487911}
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY70829') HTTP/1.1" 204 0
2026-03-30 09:09:33 [auto1.it] INFO: Found listing with ID: VV14244
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV14244%27 HTTP/1.1" 200 None
2026-03-30 09:09:33 [auto1.it] INFO: Scrape type for VV14244: 2
2026-03-30 09:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113ba613-cb0f-52f3-8c24-07fe94501dbe with identifier: VV14244
2026-03-30 09:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113ba613-cb0f-52f3-8c24-07fe94501dbe with scrape type 2
2026-03-30 09:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 113ba613-cb0f-52f3-8c24-07fe94501dbe with scrape type 2
2026-03-30 09:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 113ba613-cb0f-52f3-8c24-07fe94501dbe, identifier: VV14244
2026-03-30 09:09:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1302d10>
2026-03-30 09:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_d6572085ffcb1d220bd29c62bbb77643.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_d6572085ffcb1d220bd29c62bbb77643.jpg saved to cache
2026-03-30 09:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21fa1551-09ac-5403-9288-f1583e434852
2026-03-30 09:09:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:09:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1290b10>
2026-03-30 09:09:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_23d730db80401224f098316622a2c22a.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_23d730db80401224f098316622a2c22a.jpg saved to cache
2026-03-30 09:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21fa1551-09ac-5403-9288-f1583e434852
2026-03-30 09:09:33 [auto1.it] INFO: Found listing with ID: RX26754
2026-03-30 09:09:33 [auto1.it] INFO: Found listing with ID: BE00286
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE00286%27 HTTP/1.1" 200 None
2026-03-30 09:09:33 [auto1.it] INFO: Scrape type for BE00286: 2
2026-03-30 09:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with identifier: BE00286
2026-03-30 09:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with scrape type 2
2026-03-30 09:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with scrape type 2
2026-03-30 09:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 835657e5-8afa-5d9b-9d2b-34a38ba9ef39, identifier: BE00286
2026-03-30 09:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 113ba613-cb0f-52f3-8c24-07fe94501dbe with identifier: VV14244
2026-03-30 09:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 113ba613-cb0f-52f3-8c24-07fe94501dbe with identifier: VV14244
2026-03-30 09:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 113ba613-cb0f-52f3-8c24-07fe94501dbe with identifier: VV14244 to the API
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:36:33Z',
 'fuel_type': 'diesel',
 'id': '113ba613-cb0f-52f3-8c24-07fe94501dbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV14244',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 122914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV14244%27 HTTP/1.1" 200 None
2026-03-30 09:09:34 [auto1.it] INFO: Saving data for VV14244: {'auction_closing_time': 1774971393.0, 'created_time': 1774015971.822629, 'last_price_update_time': 1774861774.352107}
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV14244') HTTP/1.1" 204 0
2026-03-30 09:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS46243/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with identifier: BE00286
2026-03-30 09:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with identifier: BE00286
2026-03-30 09:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 835657e5-8afa-5d9b-9d2b-34a38ba9ef39 with identifier: BE00286 to the API
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:39:46Z',
 'fuel_type': 'diesel',
 'id': '835657e5-8afa-5d9b-9d2b-34a38ba9ef39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE00286',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 207944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 2.0 JTDM Sprint',
 'transmission': 'automatic',
 'trim': 'Sprint',
 'year': 2015}
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE00286%27 HTTP/1.1" 200 None
2026-03-30 09:09:34 [auto1.it] INFO: Saving data for BE00286: {'auction_closing_time': 1774971586.0, 'created_time': 1774473015.423487, 'last_price_update_time': 1774861774.729986}
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE00286') HTTP/1.1" 204 0
2026-03-30 09:09:34 [auto1.it] INFO: Found listing with ID: VK01917
2026-03-30 09:09:34 [auto1.it] INFO: Found listing with ID: MJ72891
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ72891%27 HTTP/1.1" 200 None
2026-03-30 09:09:34 [auto1.it] INFO: Scrape type for MJ72891: 1
2026-03-30 09:09:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2547b90>
2026-03-30 09:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F39%252Fd639b1b7083f97c66e84731ec6cf2777%252Fpa%252FEW53472_17c4178fc738e96a552e3cd6051833f1.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_17c4178fc738e96a552e3cd6051833f1.jpg saved to cache
2026-03-30 09:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21fa1551-09ac-5403-9288-f1583e434852
2026-03-30 09:09:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21fa1551-09ac-5403-9288-f1583e434852, skipping ID generation
2026-03-30 09:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21fa1551-09ac-5403-9288-f1583e434852 with scrape type 1
2026-03-30 09:09:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21fa1551-09ac-5403-9288-f1583e434852 sending to next pipeline
2026-03-30 09:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 21fa1551-09ac-5403-9288-f1583e434852, identifier: EW53472
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: ZA41096
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA41096%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for ZA41096: 2
2026-03-30 09:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57c8bb53-c7c7-556a-843b-b5df02e73b39 with identifier: ZA41096
2026-03-30 09:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57c8bb53-c7c7-556a-843b-b5df02e73b39 with scrape type 2
2026-03-30 09:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57c8bb53-c7c7-556a-843b-b5df02e73b39 with scrape type 2
2026-03-30 09:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57c8bb53-c7c7-556a-843b-b5df02e73b39, identifier: ZA41096
2026-03-30 09:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 21fa1551-09ac-5403-9288-f1583e434852 with identifier: EW53472
2026-03-30 09:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 21fa1551-09ac-5403-9288-f1583e434852 with identifier: EW53472
2026-03-30 09:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 21fa1551-09ac-5403-9288-f1583e434852 with identifier: EW53472 to the API
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_17c4178fc738e96a552e3cd6051833f1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:41:50Z',
 'fuel_type': 'petrol',
 'id': '21fa1551-09ac-5403-9288-f1583e434852',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW53472',
 'listing': 'auction',
 'location': 'IT, Torino',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 58775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2725535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_4c9e0949a8bd4351f1314207d4711514.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_d8d248e854fb9fc0461624982b9ad69c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2778895,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_d6572085ffcb1d220bd29c62bbb77643.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_23d730db80401224f098316622a2c22a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_b8005b9e9f84b68751cedbc5fed01b4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_202c1267f8d0fef8881e7a382ae84628.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_3123b57b7741249c3fd1feeeec699cdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2383383,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_17c4178fc738e96a552e3cd6051833f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_2e140f3352a83baca945e72e581e640a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fa1551-09ac-5403-9288-f1583e434852/21fa1551-09ac-5403-9288-f1583e434852_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/39/d639b1b7083f97c66e84731ec6cf2777/pa/EW53472_a3e61408a2f5051d77153cc742edba6d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2020}
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW53472%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Saving data for EW53472: {'created_time': 1774861775.54487, 'last_price_update_time': 1774861775.544881, 'auction_closing_time': 1774971710.0}
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EW53472') HTTP/1.1" 204 0
2026-03-30 09:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57c8bb53-c7c7-556a-843b-b5df02e73b39 with identifier: ZA41096
2026-03-30 09:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57c8bb53-c7c7-556a-843b-b5df02e73b39 with identifier: ZA41096
2026-03-30 09:09:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57c8bb53-c7c7-556a-843b-b5df02e73b39 with identifier: ZA41096 to the API
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:51:35Z',
 'fuel_type': 'petrol',
 'id': '57c8bb53-c7c7-556a-843b-b5df02e73b39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA41096',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 169080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-19',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Natural Power Panda',
 'transmission': 'manual',
 'trim': 'Natural Power',
 'year': 2009}
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA41096%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Saving data for ZA41096: {'auction_closing_time': 1774972295.0, 'created_time': 1774472759.29136, 'last_price_update_time': 1774861775.884748}
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZA41096') HTTP/1.1" 204 0
2026-03-30 09:09:35 [auto1.it] INFO: Found listing with ID: YX27089
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX27089%27 HTTP/1.1" 200 None
2026-03-30 09:09:35 [auto1.it] INFO: Scrape type for YX27089: 2
2026-03-30 09:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dac2cc93-7ed7-5b4e-a7bb-950caba2032b with identifier: YX27089
2026-03-30 09:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac2cc93-7ed7-5b4e-a7bb-950caba2032b with scrape type 2
2026-03-30 09:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dac2cc93-7ed7-5b4e-a7bb-950caba2032b with scrape type 2
2026-03-30 09:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dac2cc93-7ed7-5b4e-a7bb-950caba2032b, identifier: YX27089
2026-03-30 09:09:36 [auto1.it] INFO: Found listing with ID: US42415
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US42415%27 HTTP/1.1" 200 None
2026-03-30 09:09:36 [auto1.it] INFO: Scrape type for US42415: 2
2026-03-30 09:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a296ce5-b4cd-56f3-95cb-2be4215df125 with identifier: US42415
2026-03-30 09:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a296ce5-b4cd-56f3-95cb-2be4215df125 with scrape type 2
2026-03-30 09:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a296ce5-b4cd-56f3-95cb-2be4215df125 with scrape type 2
2026-03-30 09:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a296ce5-b4cd-56f3-95cb-2be4215df125, identifier: US42415
2026-03-30 09:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dac2cc93-7ed7-5b4e-a7bb-950caba2032b with identifier: YX27089
2026-03-30 09:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dac2cc93-7ed7-5b4e-a7bb-950caba2032b with identifier: YX27089
2026-03-30 09:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dac2cc93-7ed7-5b4e-a7bb-950caba2032b with identifier: YX27089 to the API
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:28:57Z',
 'fuel_type': 'petrol',
 'id': 'dac2cc93-7ed7-5b4e-a7bb-950caba2032b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX27089',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 175637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-30',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Elective',
 'transmission': 'manual',
 'trim': 'Elective',
 'year': 2010}
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX27089%27 HTTP/1.1" 200 None
2026-03-30 09:09:36 [auto1.it] INFO: Saving data for YX27089: {'auction_closing_time': 1774970937.0, 'created_time': 1774353942.280224, 'last_price_update_time': 1774861776.507028}
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YX27089') HTTP/1.1" 204 0
2026-03-30 09:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a296ce5-b4cd-56f3-95cb-2be4215df125 with identifier: US42415
2026-03-30 09:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a296ce5-b4cd-56f3-95cb-2be4215df125 with identifier: US42415
2026-03-30 09:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a296ce5-b4cd-56f3-95cb-2be4215df125 with identifier: US42415 to the API
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:00:03Z',
 'fuel_type': 'diesel',
 'id': '7a296ce5-b4cd-56f3-95cb-2be4215df125',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US42415',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 201916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-14',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2018}
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US42415%27 HTTP/1.1" 200 None
2026-03-30 09:09:36 [auto1.it] INFO: Saving data for US42415: {'auction_closing_time': 1774969203.0, 'created_time': 1774386543.17474, 'last_price_update_time': 1774861776.959488}
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='US42415') HTTP/1.1" 204 0
2026-03-30 09:09:36 [auto1.it] INFO: Found listing with ID: MH41109
2026-03-30 09:09:36 [auto1.it] INFO: Found listing with ID: XV30481
2026-03-30 09:09:36 [auto1.it] INFO: Found listing with ID: HA24059
2026-03-30 09:09:36 [auto1.it] INFO: Found listing with ID: HA49893
2026-03-30 09:09:36 [auto1.it] INFO: Found listing with ID: FK89155
2026-03-30 09:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK89155%27 HTTP/1.1" 200 None
2026-03-30 09:09:37 [auto1.it] INFO: Scrape type for FK89155: 1
2026-03-30 09:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:37 [auto1.it] INFO: Found listing with ID: UK52269
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK52269%27 HTTP/1.1" 200 None
2026-03-30 09:09:37 [auto1.it] INFO: Scrape type for UK52269: 2
2026-03-30 09:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ab23b2-5596-5508-8871-6a537a9782c4 with identifier: UK52269
2026-03-30 09:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ab23b2-5596-5508-8871-6a537a9782c4 with scrape type 2
2026-03-30 09:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62ab23b2-5596-5508-8871-6a537a9782c4 with scrape type 2
2026-03-30 09:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 62ab23b2-5596-5508-8871-6a537a9782c4, identifier: UK52269
2026-03-30 09:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ29537> (referer: https://www.auto1.com/v1/car-details-view/VZ29537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 62ab23b2-5596-5508-8871-6a537a9782c4 with identifier: UK52269
2026-03-30 09:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 62ab23b2-5596-5508-8871-6a537a9782c4 with identifier: UK52269
2026-03-30 09:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 62ab23b2-5596-5508-8871-6a537a9782c4 with identifier: UK52269 to the API
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:52:41Z',
 'fuel_type': 'hybrid',
 'id': '62ab23b2-5596-5508-8871-6a537a9782c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK52269',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 39718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Trend',
 'transmission': 'automatic',
 'trim': '2WD Trend',
 'year': 2021}
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK52269%27 HTTP/1.1" 200 None
2026-03-30 09:09:37 [auto1.it] INFO: Saving data for UK52269: {'auction_closing_time': 1774972361.0, 'created_time': 1774386496.294704, 'last_price_update_time': 1774861777.490501}
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK52269') HTTP/1.1" 204 0
2026-03-30 09:09:37 [auto1.it] INFO: Found listing with ID: MJ37367
2026-03-30 09:09:37 [auto1.it] INFO: Found listing with ID: AJ71510
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ71510%27 HTTP/1.1" 200 None
2026-03-30 09:09:37 [auto1.it] INFO: Scrape type for AJ71510: 2
2026-03-30 09:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a15a473e-60dc-5beb-89ee-c085147c735b with identifier: AJ71510
2026-03-30 09:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a15a473e-60dc-5beb-89ee-c085147c735b with scrape type 2
2026-03-30 09:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a15a473e-60dc-5beb-89ee-c085147c735b with scrape type 2
2026-03-30 09:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a15a473e-60dc-5beb-89ee-c085147c735b, identifier: AJ71510
2026-03-30 09:09:37 [auto1.it] INFO: Found listing with ID: GM47184
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM47184%27 HTTP/1.1" 200 None
2026-03-30 09:09:37 [auto1.it] INFO: Scrape type for GM47184: 2
2026-03-30 09:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0816e534-c038-5c4c-b1e4-da45b1a02d93 with identifier: GM47184
2026-03-30 09:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0816e534-c038-5c4c-b1e4-da45b1a02d93 with scrape type 2
2026-03-30 09:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0816e534-c038-5c4c-b1e4-da45b1a02d93 with scrape type 2
2026-03-30 09:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0816e534-c038-5c4c-b1e4-da45b1a02d93, identifier: GM47184
2026-03-30 09:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a15a473e-60dc-5beb-89ee-c085147c735b with identifier: AJ71510
2026-03-30 09:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a15a473e-60dc-5beb-89ee-c085147c735b with identifier: AJ71510
2026-03-30 09:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a15a473e-60dc-5beb-89ee-c085147c735b with identifier: AJ71510 to the API
2026-03-30 09:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:45:46Z',
 'fuel_type': 'diesel',
 'id': 'a15a473e-60dc-5beb-89ee-c085147c735b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ71510',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 175703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-02',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Rebel 4WD',
 'transmission': 'automatic',
 'trim': 'Rebel 4WD',
 'year': 2014}
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ71510%27 HTTP/1.1" 200 None
2026-03-30 09:09:38 [auto1.it] INFO: Saving data for AJ71510: {'auction_closing_time': 1774971946.0, 'created_time': 1773673854.348391, 'last_price_update_time': 1774861778.374312}
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AJ71510') HTTP/1.1" 204 0
2026-03-30 09:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0816e534-c038-5c4c-b1e4-da45b1a02d93 with identifier: GM47184
2026-03-30 09:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0816e534-c038-5c4c-b1e4-da45b1a02d93 with identifier: GM47184
2026-03-30 09:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0816e534-c038-5c4c-b1e4-da45b1a02d93 with identifier: GM47184 to the API
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:09:22Z',
 'fuel_type': 'diesel',
 'id': '0816e534-c038-5c4c-b1e4-da45b1a02d93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM47184',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 149281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-29',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.3 M-Jet Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2011}
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM47184%27 HTTP/1.1" 200 None
2026-03-30 09:09:38 [auto1.it] INFO: Saving data for GM47184: {'auction_closing_time': 1774969762.0, 'created_time': 1773237524.307596, 'last_price_update_time': 1774861778.711483}
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GM47184') HTTP/1.1" 204 0
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: VB16159
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB16159%27 HTTP/1.1" 200 None
2026-03-30 09:09:38 [auto1.it] INFO: Scrape type for VB16159: 2
2026-03-30 09:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d0a3ea3-00ae-536e-bdb1-cff7d38d3059 with identifier: VB16159
2026-03-30 09:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d0a3ea3-00ae-536e-bdb1-cff7d38d3059 with scrape type 2
2026-03-30 09:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d0a3ea3-00ae-536e-bdb1-cff7d38d3059 with scrape type 2
2026-03-30 09:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8d0a3ea3-00ae-536e-bdb1-cff7d38d3059, identifier: VB16159
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: LA93311
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: YF99217
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: MD20414
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: TM85458
2026-03-30 09:09:38 [auto1.it] INFO: Found listing with ID: CL69303
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL69303%27 HTTP/1.1" 200 None
2026-03-30 09:09:38 [auto1.it] INFO: Scrape type for CL69303: 2
2026-03-30 09:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4bb1105-2d04-58dc-bdaa-e8eeb40a1807 with identifier: CL69303
2026-03-30 09:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bb1105-2d04-58dc-bdaa-e8eeb40a1807 with scrape type 2
2026-03-30 09:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4bb1105-2d04-58dc-bdaa-e8eeb40a1807 with scrape type 2
2026-03-30 09:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e4bb1105-2d04-58dc-bdaa-e8eeb40a1807, identifier: CL69303
2026-03-30 09:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8d0a3ea3-00ae-536e-bdb1-cff7d38d3059 with identifier: VB16159
2026-03-30 09:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8d0a3ea3-00ae-536e-bdb1-cff7d38d3059 with identifier: VB16159
2026-03-30 09:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8d0a3ea3-00ae-536e-bdb1-cff7d38d3059 with identifier: VB16159 to the API
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:31:13Z',
 'fuel_type': 'diesel',
 'id': '8d0a3ea3-00ae-536e-bdb1-cff7d38d3059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB16159',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 116134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-22',
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB16159%27 HTTP/1.1" 200 None
2026-03-30 09:09:39 [auto1.it] INFO: Saving data for VB16159: {'auction_closing_time': 1774971073.0, 'created_time': 1773435922.027872, 'last_price_update_time': 1774861779.484359}
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VB16159') HTTP/1.1" 204 0
2026-03-30 09:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e4bb1105-2d04-58dc-bdaa-e8eeb40a1807 with identifier: CL69303
2026-03-30 09:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e4bb1105-2d04-58dc-bdaa-e8eeb40a1807 with identifier: CL69303
2026-03-30 09:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e4bb1105-2d04-58dc-bdaa-e8eeb40a1807 with identifier: CL69303 to the API
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:48:13Z',
 'fuel_type': 'diesel',
 'id': 'e4bb1105-2d04-58dc-bdaa-e8eeb40a1807',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL69303',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 340879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-13',
 'seller_name': None,
 'title': 'Citroen C3 1.6 Blue-HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2016}
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL69303%27 HTTP/1.1" 200 None
2026-03-30 09:09:39 [auto1.it] INFO: Saving data for CL69303: {'auction_closing_time': 1774972093.0, 'created_time': 1774472767.619384, 'last_price_update_time': 1774861779.956838}
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CL69303') HTTP/1.1" 204 0
2026-03-30 09:09:39 [auto1.it] INFO: Found listing with ID: BH25035
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH25035%27 HTTP/1.1" 200 None
2026-03-30 09:09:40 [auto1.it] INFO: Scrape type for BH25035: 2
2026-03-30 09:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37b3a9c4-88db-5c68-9c56-2f43c00e2530 with identifier: BH25035
2026-03-30 09:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37b3a9c4-88db-5c68-9c56-2f43c00e2530 with scrape type 2
2026-03-30 09:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37b3a9c4-88db-5c68-9c56-2f43c00e2530 with scrape type 2
2026-03-30 09:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 37b3a9c4-88db-5c68-9c56-2f43c00e2530, identifier: BH25035
2026-03-30 09:09:40 [auto1.it] INFO: Channel: 24h | Page: 17 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d08b2cf-664e-54c1-8810-9c9360ab579b with identifier: VZ29537
2026-03-30 09:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d08b2cf-664e-54c1-8810-9c9360ab579b with scrape type 1
2026-03-30 09:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d08b2cf-664e-54c1-8810-9c9360ab579b
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_79829c6b002fc60f8557365cacce33e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_79829c6b002fc60f8557365cacce33e3.jpg not downloaded yet
2026-03-30 09:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 37b3a9c4-88db-5c68-9c56-2f43c00e2530 with identifier: BH25035
2026-03-30 09:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 37b3a9c4-88db-5c68-9c56-2f43c00e2530 with identifier: BH25035
2026-03-30 09:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 37b3a9c4-88db-5c68-9c56-2f43c00e2530 with identifier: BH25035 to the API
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:45:34Z',
 'fuel_type': 'hybrid',
 'id': '37b3a9c4-88db-5c68-9c56-2f43c00e2530',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH25035',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'CT-Serie',
 'odometer': 148801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-16',
 'seller_name': None,
 'title': 'Lexus CT-Serie CT 200h Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2012}
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH25035%27 HTTP/1.1" 200 None
2026-03-30 09:09:40 [auto1.it] INFO: Saving data for BH25035: {'auction_closing_time': 1774971934.0, 'created_time': 1773349524.659679, 'last_price_update_time': 1774861780.653845}
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BH25035') HTTP/1.1" 204 0
2026-03-30 09:09:40 [auto1.it] INFO: Found listing with ID: RC86938
2026-03-30 09:09:40 [auto1.it] INFO: Found listing with ID: MB21840
2026-03-30 09:09:40 [auto1.it] INFO: Found listing with ID: CT16450
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT16450%27 HTTP/1.1" 200 None
2026-03-30 09:09:40 [auto1.it] INFO: Scrape type for CT16450: 2
2026-03-30 09:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41943d1-2046-54c8-993e-51c84a1584c2 with identifier: CT16450
2026-03-30 09:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41943d1-2046-54c8-993e-51c84a1584c2 with scrape type 2
2026-03-30 09:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41943d1-2046-54c8-993e-51c84a1584c2 with scrape type 2
2026-03-30 09:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a41943d1-2046-54c8-993e-51c84a1584c2, identifier: CT16450
2026-03-30 09:09:40 [auto1.it] INFO: Found listing with ID: UX20076
2026-03-30 09:09:40 [auto1.it] INFO: Found listing with ID: KK34304
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK34304%27 HTTP/1.1" 200 None
2026-03-30 09:09:40 [auto1.it] INFO: Scrape type for KK34304: 2
2026-03-30 09:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4ffeced-1fbd-5ba1-94eb-dff21aa3f104 with identifier: KK34304
2026-03-30 09:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4ffeced-1fbd-5ba1-94eb-dff21aa3f104 with scrape type 2
2026-03-30 09:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4ffeced-1fbd-5ba1-94eb-dff21aa3f104 with scrape type 2
2026-03-30 09:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f4ffeced-1fbd-5ba1-94eb-dff21aa3f104, identifier: KK34304
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_a91b4ccecdd9bb28c17a3b5cb9f952dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_a91b4ccecdd9bb28c17a3b5cb9f952dc.jpg not downloaded yet
2026-03-30 09:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a41943d1-2046-54c8-993e-51c84a1584c2 with identifier: CT16450
2026-03-30 09:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a41943d1-2046-54c8-993e-51c84a1584c2 with identifier: CT16450
2026-03-30 09:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a41943d1-2046-54c8-993e-51c84a1584c2 with identifier: CT16450 to the API
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:29:13Z',
 'fuel_type': 'diesel',
 'id': 'a41943d1-2046-54c8-993e-51c84a1584c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT16450',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 135312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-27',
 'seller_name': None,
 'title': 'Fiat Punto 1.3 JTD DPF Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2015}
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT16450%27 HTTP/1.1" 200 None
2026-03-30 09:09:41 [auto1.it] INFO: Saving data for CT16450: {'auction_closing_time': 1774970953.0, 'created_time': 1774008386.539092, 'last_price_update_time': 1774861781.851335}
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CT16450') HTTP/1.1" 204 0
2026-03-30 09:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f4ffeced-1fbd-5ba1-94eb-dff21aa3f104 with identifier: KK34304
2026-03-30 09:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f4ffeced-1fbd-5ba1-94eb-dff21aa3f104 with identifier: KK34304
2026-03-30 09:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f4ffeced-1fbd-5ba1-94eb-dff21aa3f104 with identifier: KK34304 to the API
2026-03-30 09:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:15:59Z',
 'fuel_type': 'petrol',
 'id': 'f4ffeced-1fbd-5ba1-94eb-dff21aa3f104',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK34304',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 94673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-26',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2011}
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK34304%27 HTTP/1.1" 200 None
2026-03-30 09:09:42 [auto1.it] INFO: Saving data for KK34304: {'auction_closing_time': 1774970159.0, 'created_time': 1774354036.387809, 'last_price_update_time': 1774861782.226955}
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KK34304') HTTP/1.1" 204 0
2026-03-30 09:09:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:42 [auto1.it] INFO: Found listing with ID: MH67906
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH67906%27 HTTP/1.1" 200 None
2026-03-30 09:09:42 [auto1.it] INFO: Scrape type for MH67906: 2
2026-03-30 09:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b835c0f9-18c6-5c58-bca1-1e93070f06d2 with identifier: MH67906
2026-03-30 09:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b835c0f9-18c6-5c58-bca1-1e93070f06d2 with scrape type 2
2026-03-30 09:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b835c0f9-18c6-5c58-bca1-1e93070f06d2 with scrape type 2
2026-03-30 09:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b835c0f9-18c6-5c58-bca1-1e93070f06d2, identifier: MH67906
2026-03-30 09:09:42 [auto1.it] INFO: Found listing with ID: XM71066
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM71066%27 HTTP/1.1" 200 None
2026-03-30 09:09:42 [auto1.it] INFO: Scrape type for XM71066: 2
2026-03-30 09:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a1fd0c-b7e5-526f-817e-beea1153ebd8 with identifier: XM71066
2026-03-30 09:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a1fd0c-b7e5-526f-817e-beea1153ebd8 with scrape type 2
2026-03-30 09:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91a1fd0c-b7e5-526f-817e-beea1153ebd8 with scrape type 2
2026-03-30 09:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 91a1fd0c-b7e5-526f-817e-beea1153ebd8, identifier: XM71066
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_6c0ace9d9669bac2ea96cc7bd1e1f3c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_6c0ace9d9669bac2ea96cc7bd1e1f3c2.jpg not downloaded yet
2026-03-30 09:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b835c0f9-18c6-5c58-bca1-1e93070f06d2 with identifier: MH67906
2026-03-30 09:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b835c0f9-18c6-5c58-bca1-1e93070f06d2 with identifier: MH67906
2026-03-30 09:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b835c0f9-18c6-5c58-bca1-1e93070f06d2 with identifier: MH67906 to the API
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-31T15:51:16Z',
 'fuel_type': 'diesel',
 'id': 'b835c0f9-18c6-5c58-bca1-1e93070f06d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH67906',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 107532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seller_name': None,
 'title': 'Volvo V60 2.0 B4 Mild-Hybrid Momentum Business',
 'transmission': 'automatic',
 'trim': 'Momentum Business',
 'year': 2021}
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH67906%27 HTTP/1.1" 200 None
2026-03-30 09:09:42 [auto1.it] INFO: Saving data for MH67906: {'auction_closing_time': 1774972276.0, 'created_time': 1774386329.838173, 'last_price_update_time': 1774861782.883559}
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MH67906') HTTP/1.1" 204 0
2026-03-30 09:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 91a1fd0c-b7e5-526f-817e-beea1153ebd8 with identifier: XM71066
2026-03-30 09:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 91a1fd0c-b7e5-526f-817e-beea1153ebd8 with identifier: XM71066
2026-03-30 09:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 91a1fd0c-b7e5-526f-817e-beea1153ebd8 with identifier: XM71066 to the API
2026-03-30 09:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:39:31Z',
 'fuel_type': 'diesel',
 'id': '91a1fd0c-b7e5-526f-817e-beea1153ebd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM71066',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 111770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-30',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 320 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2005}
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM71066%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Saving data for XM71066: {'auction_closing_time': 1774971571.0, 'created_time': 1773349526.113738, 'last_price_update_time': 1774861783.256674}
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XM71066') HTTP/1.1" 204 0
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: BZ38599
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: GR20661
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR20661%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for GR20661: 2
2026-03-30 09:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95d36f0b-e1f2-590c-a57b-cce34a758e98 with identifier: GR20661
2026-03-30 09:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95d36f0b-e1f2-590c-a57b-cce34a758e98 with scrape type 2
2026-03-30 09:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95d36f0b-e1f2-590c-a57b-cce34a758e98 with scrape type 2
2026-03-30 09:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95d36f0b-e1f2-590c-a57b-cce34a758e98, identifier: GR20661
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: BU32939
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: ZF50990
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: YV30148
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: NY67397
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: VM52207
2026-03-30 09:09:43 [auto1.it] INFO: Found listing with ID: GR99971
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR99971%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Scrape type for GR99971: 2
2026-03-30 09:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1210778a-d5f0-579e-bab3-df17f0655425 with identifier: GR99971
2026-03-30 09:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1210778a-d5f0-579e-bab3-df17f0655425 with scrape type 2
2026-03-30 09:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1210778a-d5f0-579e-bab3-df17f0655425 with scrape type 2
2026-03-30 09:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1210778a-d5f0-579e-bab3-df17f0655425, identifier: GR99971
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_9fd28cba698c72965d0ddc050015869e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_9fd28cba698c72965d0ddc050015869e.jpg not downloaded yet
2026-03-30 09:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95d36f0b-e1f2-590c-a57b-cce34a758e98 with identifier: GR20661
2026-03-30 09:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95d36f0b-e1f2-590c-a57b-cce34a758e98 with identifier: GR20661
2026-03-30 09:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 95d36f0b-e1f2-590c-a57b-cce34a758e98 with identifier: GR20661 to the API
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:19:07Z',
 'fuel_type': 'diesel',
 'id': '95d36f0b-e1f2-590c-a57b-cce34a758e98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR20661',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 191756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-06',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2017}
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR20661%27 HTTP/1.1" 200 None
2026-03-30 09:09:43 [auto1.it] INFO: Saving data for GR20661: {'auction_closing_time': 1774970347.0, 'created_time': 1772745521.660239, 'last_price_update_time': 1774861783.873831}
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GR20661') HTTP/1.1" 204 0
2026-03-30 09:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1210778a-d5f0-579e-bab3-df17f0655425 with identifier: GR99971
2026-03-30 09:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1210778a-d5f0-579e-bab3-df17f0655425 with identifier: GR99971
2026-03-30 09:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1210778a-d5f0-579e-bab3-df17f0655425 with identifier: GR99971 to the API
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:55:02Z',
 'fuel_type': 'petrol',
 'id': '1210778a-d5f0-579e-bab3-df17f0655425',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR99971',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 72380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-27',
 'seller_name': None,
 'title': 'Fiat 500 1.2 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2016}
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR99971%27 HTTP/1.1" 200 None
2026-03-30 09:09:44 [auto1.it] INFO: Saving data for GR99971: {'auction_closing_time': 1774972502.0, 'created_time': 1774386754.271922, 'last_price_update_time': 1774861784.557061}
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GR99971') HTTP/1.1" 204 0
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: BZ19379
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ19379%27 HTTP/1.1" 200 None
2026-03-30 09:09:44 [auto1.it] INFO: Scrape type for BZ19379: 2
2026-03-30 09:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cebbfcb6-c67c-5b3c-acd6-1fb550572e48 with identifier: BZ19379
2026-03-30 09:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cebbfcb6-c67c-5b3c-acd6-1fb550572e48 with scrape type 2
2026-03-30 09:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cebbfcb6-c67c-5b3c-acd6-1fb550572e48 with scrape type 2
2026-03-30 09:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cebbfcb6-c67c-5b3c-acd6-1fb550572e48, identifier: BZ19379
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: ZZ58047
2026-03-30 09:09:44 [auto1.it] INFO: Found listing with ID: PZ68086
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ68086%27 HTTP/1.1" 200 None
2026-03-30 09:09:44 [auto1.it] INFO: Scrape type for PZ68086: 2
2026-03-30 09:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293c8f67-cbcb-5471-954c-d28a33e55668 with identifier: PZ68086
2026-03-30 09:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293c8f67-cbcb-5471-954c-d28a33e55668 with scrape type 2
2026-03-30 09:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293c8f67-cbcb-5471-954c-d28a33e55668 with scrape type 2
2026-03-30 09:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 293c8f67-cbcb-5471-954c-d28a33e55668, identifier: PZ68086
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_f06fcf7e113f513fc2d8a3e235f09ecd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_f06fcf7e113f513fc2d8a3e235f09ecd.jpg not downloaded yet
2026-03-30 09:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cebbfcb6-c67c-5b3c-acd6-1fb550572e48 with identifier: BZ19379
2026-03-30 09:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cebbfcb6-c67c-5b3c-acd6-1fb550572e48 with identifier: BZ19379
2026-03-30 09:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cebbfcb6-c67c-5b3c-acd6-1fb550572e48 with identifier: BZ19379 to the API
2026-03-30 09:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:57:48Z',
 'fuel_type': 'diesel',
 'id': 'cebbfcb6-c67c-5b3c-acd6-1fb550572e48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ19379',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 94671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-30',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ19379%27 HTTP/1.1" 200 None
2026-03-30 09:09:45 [auto1.it] INFO: Saving data for BZ19379: {'auction_closing_time': 1774972668.0, 'created_time': 1774429519.510804, 'last_price_update_time': 1774861785.24604}
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BZ19379') HTTP/1.1" 204 0
2026-03-30 09:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 293c8f67-cbcb-5471-954c-d28a33e55668 with identifier: PZ68086
2026-03-30 09:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 293c8f67-cbcb-5471-954c-d28a33e55668 with identifier: PZ68086
2026-03-30 09:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 293c8f67-cbcb-5471-954c-d28a33e55668 with identifier: PZ68086 to the API
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:50:40Z',
 'fuel_type': 'diesel',
 'id': '293c8f67-cbcb-5471-954c-d28a33e55668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ68086',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 242208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-30',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Business-Line',
 'transmission': 'automatic',
 'trim': 'Business-Line',
 'year': 2012}
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ68086%27 HTTP/1.1" 200 None
2026-03-30 09:09:45 [auto1.it] INFO: Saving data for PZ68086: {'auction_closing_time': 1774972240.0, 'created_time': 1773137863.080094, 'last_price_update_time': 1774861785.629021}
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ68086') HTTP/1.1" 204 0
2026-03-30 09:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_a91b4ccecdd9bb28c17a3b5cb9f952dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:45 [auto1.it] INFO: Found listing with ID: MX71384
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX71384%27 HTTP/1.1" 200 None
2026-03-30 09:09:45 [auto1.it] INFO: Scrape type for MX71384: 2
2026-03-30 09:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4cfad99-2ad4-516f-82bf-4e4de09eb8f3 with identifier: MX71384
2026-03-30 09:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4cfad99-2ad4-516f-82bf-4e4de09eb8f3 with scrape type 2
2026-03-30 09:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4cfad99-2ad4-516f-82bf-4e4de09eb8f3 with scrape type 2
2026-03-30 09:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f4cfad99-2ad4-516f-82bf-4e4de09eb8f3, identifier: MX71384
2026-03-30 09:09:45 [auto1.it] INFO: Found listing with ID: UT61687
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT61687%27 HTTP/1.1" 200 None
2026-03-30 09:09:45 [auto1.it] INFO: Scrape type for UT61687: 2
2026-03-30 09:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5911a01e-86da-5d04-b8ed-f97074f552e5 with identifier: UT61687
2026-03-30 09:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5911a01e-86da-5d04-b8ed-f97074f552e5 with scrape type 2
2026-03-30 09:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5911a01e-86da-5d04-b8ed-f97074f552e5 with scrape type 2
2026-03-30 09:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5911a01e-86da-5d04-b8ed-f97074f552e5, identifier: UT61687
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_b86cea7c05a76fcf7a78375d963f856c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_b86cea7c05a76fcf7a78375d963f856c.jpg not downloaded yet
2026-03-30 09:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV48837> (referer: https://www.auto1.com/v1/car-details-view/WV48837/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f4cfad99-2ad4-516f-82bf-4e4de09eb8f3 with identifier: MX71384
2026-03-30 09:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f4cfad99-2ad4-516f-82bf-4e4de09eb8f3 with identifier: MX71384
2026-03-30 09:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f4cfad99-2ad4-516f-82bf-4e4de09eb8f3 with identifier: MX71384 to the API
2026-03-30 09:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:05:25Z',
 'fuel_type': 'diesel',
 'id': 'f4cfad99-2ad4-516f-82bf-4e4de09eb8f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX71384',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 177340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-07',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX71384%27 HTTP/1.1" 200 None
2026-03-30 09:09:46 [auto1.it] INFO: Saving data for MX71384: {'auction_closing_time': 1774969525.0, 'created_time': 1774472729.245295, 'last_price_update_time': 1774861786.256672}
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MX71384') HTTP/1.1" 204 0
2026-03-30 09:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5911a01e-86da-5d04-b8ed-f97074f552e5 with identifier: UT61687
2026-03-30 09:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5911a01e-86da-5d04-b8ed-f97074f552e5 with identifier: UT61687
2026-03-30 09:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5911a01e-86da-5d04-b8ed-f97074f552e5 with identifier: UT61687 to the API
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:12:25Z',
 'fuel_type': 'petrol',
 'id': '5911a01e-86da-5d04-b8ed-f97074f552e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT61687',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 114261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-18',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2017}
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT61687%27 HTTP/1.1" 200 None
2026-03-30 09:09:46 [auto1.it] INFO: Saving data for UT61687: {'auction_closing_time': 1774969945.0, 'created_time': 1774447546.01971, 'last_price_update_time': 1774861786.797153}
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UT61687') HTTP/1.1" 204 0
2026-03-30 09:09:46 [auto1.it] INFO: Found listing with ID: CZ45598
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ45598%27 HTTP/1.1" 200 None
2026-03-30 09:09:46 [auto1.it] INFO: Scrape type for CZ45598: 2
2026-03-30 09:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5885f834-fdbf-53a9-88ca-d26294548c7e with identifier: CZ45598
2026-03-30 09:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5885f834-fdbf-53a9-88ca-d26294548c7e with scrape type 2
2026-03-30 09:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5885f834-fdbf-53a9-88ca-d26294548c7e with scrape type 2
2026-03-30 09:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5885f834-fdbf-53a9-88ca-d26294548c7e, identifier: CZ45598
2026-03-30 09:09:46 [auto1.it] INFO: Found listing with ID: ZY19539
2026-03-30 09:09:46 [auto1.it] INFO: Found listing with ID: ZH83607
2026-03-30 09:09:46 [auto1.it] INFO: Found listing with ID: GW68034
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW68034%27 HTTP/1.1" 200 None
2026-03-30 09:09:46 [auto1.it] INFO: Scrape type for GW68034: 2
2026-03-30 09:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c632fea5-7a7e-515d-b7d4-26e467cf2a0f with identifier: GW68034
2026-03-30 09:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c632fea5-7a7e-515d-b7d4-26e467cf2a0f with scrape type 2
2026-03-30 09:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c632fea5-7a7e-515d-b7d4-26e467cf2a0f with scrape type 2
2026-03-30 09:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c632fea5-7a7e-515d-b7d4-26e467cf2a0f, identifier: GW68034
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_600b7335fd37112f3f915f168ca63f49.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_600b7335fd37112f3f915f168ca63f49.jpg not downloaded yet
2026-03-30 09:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ72891/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS46243> (referer: https://www.auto1.com/v1/car-details-view/LS46243/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_6c0ace9d9669bac2ea96cc7bd1e1f3c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_9fd28cba698c72965d0ddc050015869e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5885f834-fdbf-53a9-88ca-d26294548c7e with identifier: CZ45598
2026-03-30 09:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5885f834-fdbf-53a9-88ca-d26294548c7e with identifier: CZ45598
2026-03-30 09:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5885f834-fdbf-53a9-88ca-d26294548c7e with identifier: CZ45598 to the API
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:49:16Z',
 'fuel_type': 'diesel',
 'id': '5885f834-fdbf-53a9-88ca-d26294548c7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ45598',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 322784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-05',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Xpossible ISG 2WD',
 'transmission': 'manual',
 'trim': 'Xpossible ISG 2WD',
 'year': 2018}
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ45598%27 HTTP/1.1" 200 None
2026-03-30 09:09:47 [auto1.it] INFO: Saving data for CZ45598: {'auction_closing_time': 1774972156.0, 'created_time': 1773136390.024391, 'last_price_update_time': 1774861787.417306}
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ45598') HTTP/1.1" 204 0
2026-03-30 09:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c632fea5-7a7e-515d-b7d4-26e467cf2a0f with identifier: GW68034
2026-03-30 09:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c632fea5-7a7e-515d-b7d4-26e467cf2a0f with identifier: GW68034
2026-03-30 09:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c632fea5-7a7e-515d-b7d4-26e467cf2a0f with identifier: GW68034 to the API
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:36:02Z',
 'fuel_type': 'diesel',
 'id': 'c632fea5-7a7e-515d-b7d4-26e467cf2a0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW68034',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 110442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-13',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Evolve 2WD',
 'transmission': 'automatic',
 'trim': 'Evolve 2WD',
 'year': 2015}
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW68034%27 HTTP/1.1" 200 None
2026-03-30 09:09:47 [auto1.it] INFO: Saving data for GW68034: {'auction_closing_time': 1774971362.0, 'created_time': 1774440376.891396, 'last_price_update_time': 1774861787.77793}
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GW68034') HTTP/1.1" 204 0
2026-03-30 09:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2576450>
2026-03-30 09:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_a91b4ccecdd9bb28c17a3b5cb9f952dc.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_a91b4ccecdd9bb28c17a3b5cb9f952dc.jpg saved to cache
2026-03-30 09:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d08b2cf-664e-54c1-8810-9c9360ab579b
2026-03-30 09:09:47 [auto1.it] INFO: Found listing with ID: LL47627
2026-03-30 09:09:47 [auto1.it] INFO: Found listing with ID: JF46642
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF46642%27 HTTP/1.1" 200 None
2026-03-30 09:09:47 [auto1.it] INFO: Scrape type for JF46642: 2
2026-03-30 09:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77aae8ee-0df6-5107-9f7e-aba058099b0c with identifier: JF46642
2026-03-30 09:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77aae8ee-0df6-5107-9f7e-aba058099b0c with scrape type 2
2026-03-30 09:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77aae8ee-0df6-5107-9f7e-aba058099b0c with scrape type 2
2026-03-30 09:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 77aae8ee-0df6-5107-9f7e-aba058099b0c, identifier: JF46642
2026-03-30 09:09:47 [auto1.it] INFO: Found listing with ID: DM89390
2026-03-30 09:09:47 [auto1.it] INFO: Found listing with ID: BX66797
2026-03-30 09:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX66797%27 HTTP/1.1" 200 None
2026-03-30 09:09:48 [auto1.it] INFO: Scrape type for BX66797: 2
2026-03-30 09:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a240899c-c08f-5c2f-824e-a71f51fc8614 with identifier: BX66797
2026-03-30 09:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a240899c-c08f-5c2f-824e-a71f51fc8614 with scrape type 2
2026-03-30 09:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a240899c-c08f-5c2f-824e-a71f51fc8614 with scrape type 2
2026-03-30 09:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a240899c-c08f-5c2f-824e-a71f51fc8614, identifier: BX66797
2026-03-30 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_264bc7bffbeb617a17da21dcc44f99b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_264bc7bffbeb617a17da21dcc44f99b4.jpg not downloaded yet
2026-03-30 09:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 77aae8ee-0df6-5107-9f7e-aba058099b0c with identifier: JF46642
2026-03-30 09:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 77aae8ee-0df6-5107-9f7e-aba058099b0c with identifier: JF46642
2026-03-30 09:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 77aae8ee-0df6-5107-9f7e-aba058099b0c with identifier: JF46642 to the API
2026-03-30 09:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:04:15Z',
 'fuel_type': 'petrol',
 'id': '77aae8ee-0df6-5107-9f7e-aba058099b0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF46642',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 210938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-21',
 'seller_name': None,
 'title': 'Citroen C3 1.1 Séduction',
 'transmission': 'manual',
 'trim': 'Séduction',
 'year': 2012}
2026-03-30 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF46642%27 HTTP/1.1" 200 None
2026-03-30 09:09:48 [auto1.it] INFO: Saving data for JF46642: {'auction_closing_time': 1774969455.0, 'created_time': 1773270379.045907, 'last_price_update_time': 1774861788.420822}
2026-03-30 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JF46642') HTTP/1.1" 204 0
2026-03-30 09:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a240899c-c08f-5c2f-824e-a71f51fc8614 with identifier: BX66797
2026-03-30 09:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a240899c-c08f-5c2f-824e-a71f51fc8614 with identifier: BX66797
2026-03-30 09:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a240899c-c08f-5c2f-824e-a71f51fc8614 with identifier: BX66797 to the API
2026-03-30 09:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:34:14Z',
 'fuel_type': 'diesel',
 'id': 'a240899c-c08f-5c2f-824e-a71f51fc8614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX66797',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 74287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-15',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2019}
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX66797%27 HTTP/1.1" 200 None
2026-03-30 09:09:49 [auto1.it] INFO: Saving data for BX66797: {'auction_closing_time': 1774971254.0, 'created_time': 1774354316.988041, 'last_price_update_time': 1774861789.248001}
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BX66797') HTTP/1.1" 204 0
2026-03-30 09:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1675eec-006b-5c7e-be01-0691c6fd13ea with identifier: WV48837
2026-03-30 09:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1675eec-006b-5c7e-be01-0691c6fd13ea with scrape type 1
2026-03-30 09:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1675eec-006b-5c7e-be01-0691c6fd13ea
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_98bf0963637fe4f42c432e3f2ecd01cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_98bf0963637fe4f42c432e3f2ecd01cf.jpg not downloaded yet
2026-03-30 09:09:49 [auto1.it] INFO: Found listing with ID: GZ96497
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ96497%27 HTTP/1.1" 200 None
2026-03-30 09:09:49 [auto1.it] INFO: Scrape type for GZ96497: 2
2026-03-30 09:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1568b776-8fdf-5175-8fb6-1b5d3fe2f627 with identifier: GZ96497
2026-03-30 09:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1568b776-8fdf-5175-8fb6-1b5d3fe2f627 with scrape type 2
2026-03-30 09:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1568b776-8fdf-5175-8fb6-1b5d3fe2f627 with scrape type 2
2026-03-30 09:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1568b776-8fdf-5175-8fb6-1b5d3fe2f627, identifier: GZ96497
2026-03-30 09:09:49 [auto1.it] INFO: Found listing with ID: UL03529
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL03529%27 HTTP/1.1" 200 None
2026-03-30 09:09:49 [auto1.it] INFO: Scrape type for UL03529: 2
2026-03-30 09:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ad5ad0c-d22f-5870-a722-76166359e306 with identifier: UL03529
2026-03-30 09:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ad5ad0c-d22f-5870-a722-76166359e306 with scrape type 2
2026-03-30 09:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ad5ad0c-d22f-5870-a722-76166359e306 with scrape type 2
2026-03-30 09:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ad5ad0c-d22f-5870-a722-76166359e306, identifier: UL03529
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_231d3e1294e423fe9c1fddf3278ad145.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_231d3e1294e423fe9c1fddf3278ad145.jpg not downloaded yet
2026-03-30 09:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1568b776-8fdf-5175-8fb6-1b5d3fe2f627 with identifier: GZ96497
2026-03-30 09:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1568b776-8fdf-5175-8fb6-1b5d3fe2f627 with identifier: GZ96497
2026-03-30 09:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1568b776-8fdf-5175-8fb6-1b5d3fe2f627 with identifier: GZ96497 to the API
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:47:10Z',
 'fuel_type': 'petrol',
 'id': '1568b776-8fdf-5175-8fb6-1b5d3fe2f627',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ96497',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 207566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-30',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ96497%27 HTTP/1.1" 200 None
2026-03-30 09:09:49 [auto1.it] INFO: Saving data for GZ96497: {'auction_closing_time': 1774972030.0, 'created_time': 1774361301.946745, 'last_price_update_time': 1774861789.893399}
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ96497') HTTP/1.1" 204 0
2026-03-30 09:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ad5ad0c-d22f-5870-a722-76166359e306 with identifier: UL03529
2026-03-30 09:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ad5ad0c-d22f-5870-a722-76166359e306 with identifier: UL03529
2026-03-30 09:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ad5ad0c-d22f-5870-a722-76166359e306 with identifier: UL03529 to the API
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:38:47Z',
 'fuel_type': 'diesel',
 'id': '6ad5ad0c-d22f-5870-a722-76166359e306',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL03529',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 169706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2015}
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL03529%27 HTTP/1.1" 200 None
2026-03-30 09:09:50 [auto1.it] INFO: Saving data for UL03529: {'auction_closing_time': 1774971527.0, 'created_time': 1773954808.092194, 'last_price_update_time': 1774861790.27165}
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL03529') HTTP/1.1" 204 0
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_d20c88b28432246604192cccdc298f59.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_d20c88b28432246604192cccdc298f59.jpg not downloaded yet
2026-03-30 09:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17eeae6e-d20c-58f6-a5e5-a37bc88acb10 with identifier: LS46243
2026-03-30 09:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10 with scrape type 1
2026-03-30 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_4ac4885c2adff726bed64bba3247bc7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_4ac4885c2adff726bed64bba3247bc7b.jpg not downloaded yet
2026-03-30 09:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee109d510>
2026-03-30 09:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_6c0ace9d9669bac2ea96cc7bd1e1f3c2.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_6c0ace9d9669bac2ea96cc7bd1e1f3c2.jpg saved to cache
2026-03-30 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d08b2cf-664e-54c1-8810-9c9360ab579b
2026-03-30 09:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1324c50>
2026-03-30 09:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_9fd28cba698c72965d0ddc050015869e.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_9fd28cba698c72965d0ddc050015869e.jpg saved to cache
2026-03-30 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d08b2cf-664e-54c1-8810-9c9360ab579b
2026-03-30 09:09:50 [auto1.it] INFO: Found listing with ID: MA97320
2026-03-30 09:09:50 [auto1.it] INFO: Found listing with ID: SU50076
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU50076%27 HTTP/1.1" 200 None
2026-03-30 09:09:50 [auto1.it] INFO: Scrape type for SU50076: 1
2026-03-30 09:09:50 [auto1.it] INFO: Found listing with ID: TJ83319
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ83319%27 HTTP/1.1" 200 None
2026-03-30 09:09:50 [auto1.it] INFO: Scrape type for TJ83319: 2
2026-03-30 09:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c44cab3e-daa7-5071-950f-8a8f891ac1b3 with identifier: TJ83319
2026-03-30 09:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c44cab3e-daa7-5071-950f-8a8f891ac1b3 with scrape type 2
2026-03-30 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c44cab3e-daa7-5071-950f-8a8f891ac1b3 with scrape type 2
2026-03-30 09:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c44cab3e-daa7-5071-950f-8a8f891ac1b3, identifier: TJ83319
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_588c849a08b2bab2b1ed8121fc451a31.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_588c849a08b2bab2b1ed8121fc451a31.jpg not downloaded yet
2026-03-30 09:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c44cab3e-daa7-5071-950f-8a8f891ac1b3 with identifier: TJ83319
2026-03-30 09:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c44cab3e-daa7-5071-950f-8a8f891ac1b3 with identifier: TJ83319
2026-03-30 09:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c44cab3e-daa7-5071-950f-8a8f891ac1b3 with identifier: TJ83319 to the API
2026-03-30 09:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:12:49Z',
 'fuel_type': 'diesel',
 'id': 'c44cab3e-daa7-5071-950f-8a8f891ac1b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ83319',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 219441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-26',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2016}
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ83319%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Saving data for TJ83319: {'auction_closing_time': 1774969969.0, 'created_time': 1773781521.210551, 'last_price_update_time': 1774861791.216627}
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ83319') HTTP/1.1" 204 0
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_b05a4d2c57c65c943e495cdb80b07f03.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_b05a4d2c57c65c943e495cdb80b07f03.jpg not downloaded yet
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_5423bff1538f19270aeaa02fd5bfa41b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_5423bff1538f19270aeaa02fd5bfa41b.jpg not downloaded yet
2026-03-30 09:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_79829c6b002fc60f8557365cacce33e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: PM97583
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: KA09698
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: BF97905
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF97905%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for BF97905: 2
2026-03-30 09:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bd7578f-620f-5c72-9176-efcaa778fa23 with identifier: BF97905
2026-03-30 09:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bd7578f-620f-5c72-9176-efcaa778fa23 with scrape type 2
2026-03-30 09:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bd7578f-620f-5c72-9176-efcaa778fa23 with scrape type 2
2026-03-30 09:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0bd7578f-620f-5c72-9176-efcaa778fa23, identifier: BF97905
2026-03-30 09:09:51 [auto1.it] INFO: Found listing with ID: EX36088
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX36088%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Scrape type for EX36088: 2
2026-03-30 09:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21804744-7d4d-5969-920c-696b6e885340 with identifier: EX36088
2026-03-30 09:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21804744-7d4d-5969-920c-696b6e885340 with scrape type 2
2026-03-30 09:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21804744-7d4d-5969-920c-696b6e885340 with scrape type 2
2026-03-30 09:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 21804744-7d4d-5969-920c-696b6e885340, identifier: EX36088
2026-03-30 09:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:51 [auto1.it] INFO: Channel: 24h | Page: 18 | totalHits: 3307 | hits on page: 40
2026-03-30 09:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0bd7578f-620f-5c72-9176-efcaa778fa23 with identifier: BF97905
2026-03-30 09:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0bd7578f-620f-5c72-9176-efcaa778fa23 with identifier: BF97905
2026-03-30 09:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0bd7578f-620f-5c72-9176-efcaa778fa23 with identifier: BF97905 to the API
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:21:00Z',
 'fuel_type': 'diesel',
 'id': '0bd7578f-620f-5c72-9176-efcaa778fa23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF97905',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 56185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.8 DI-D Intense 2WD',
 'transmission': 'manual',
 'trim': 'Intense 2WD',
 'year': 2015}
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF97905%27 HTTP/1.1" 200 None
2026-03-30 09:09:51 [auto1.it] INFO: Saving data for BF97905: {'auction_closing_time': 1774970460.0, 'created_time': 1773236748.443199, 'last_price_update_time': 1774861791.871793}
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BF97905') HTTP/1.1" 204 0
2026-03-30 09:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 21804744-7d4d-5969-920c-696b6e885340 with identifier: EX36088
2026-03-30 09:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 21804744-7d4d-5969-920c-696b6e885340 with identifier: EX36088
2026-03-30 09:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 21804744-7d4d-5969-920c-696b6e885340 with identifier: EX36088 to the API
2026-03-30 09:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:48:05Z',
 'fuel_type': 'diesel',
 'id': '21804744-7d4d-5969-920c-696b6e885340',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX36088',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 162807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-10',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.4 HDi Affaire',
 'transmission': 'manual',
 'trim': 'Affaire',
 'year': 2010}
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX36088%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [auto1.it] INFO: Saving data for EX36088: {'auction_closing_time': 1774972085.0, 'created_time': 1773233066.301199, 'last_price_update_time': 1774861792.269391}
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EX36088') HTTP/1.1" 204 0
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_cbeeddbab0aee4e90a03da5577156759.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_cbeeddbab0aee4e90a03da5577156759.jpg not downloaded yet
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_fd70c99f2983fa416a5938095c95bd8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_fd70c99f2983fa416a5938095c95bd8b.jpg not downloaded yet
2026-03-30 09:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_98bf0963637fe4f42c432e3f2ecd01cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: EY09405
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: EV42289
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: KC61332
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC61332%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [auto1.it] INFO: Scrape type for KC61332: 2
2026-03-30 09:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with identifier: KC61332
2026-03-30 09:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with scrape type 2
2026-03-30 09:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with scrape type 2
2026-03-30 09:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4991ee03-7039-5b9e-984e-fd5ac5fe8b57, identifier: KC61332
2026-03-30 09:09:52 [auto1.it] INFO: Found listing with ID: MA00484
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA00484%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [auto1.it] INFO: Scrape type for MA00484: 2
2026-03-30 09:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a24f71a0-7a84-5b1e-9645-d7bc5078f784 with identifier: MA00484
2026-03-30 09:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a24f71a0-7a84-5b1e-9645-d7bc5078f784 with scrape type 2
2026-03-30 09:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a24f71a0-7a84-5b1e-9645-d7bc5078f784 with scrape type 2
2026-03-30 09:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a24f71a0-7a84-5b1e-9645-d7bc5078f784, identifier: MA00484
2026-03-30 09:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_231d3e1294e423fe9c1fddf3278ad145.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with identifier: KC61332
2026-03-30 09:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with identifier: KC61332
2026-03-30 09:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4991ee03-7039-5b9e-984e-fd5ac5fe8b57 with identifier: KC61332 to the API
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-31T15:34:13Z',
 'fuel_type': 'diesel',
 'id': '4991ee03-7039-5b9e-984e-fd5ac5fe8b57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC61332',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 148847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic Premium Plus',
 'transmission': 'automatic',
 'trim': '4Matic Premium Plus',
 'year': 2020}
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC61332%27 HTTP/1.1" 200 None
2026-03-30 09:09:52 [auto1.it] INFO: Saving data for KC61332: {'auction_closing_time': 1774971253.0, 'created_time': 1773997567.9014, 'last_price_update_time': 1774861792.8766}
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC61332') HTTP/1.1" 204 0
2026-03-30 09:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_90d0753f6173149b4b03962e65334950.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_90d0753f6173149b4b03962e65334950.jpg not downloaded yet
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_7f632c34ba8b74b0e91c4eaff724321d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_7f632c34ba8b74b0e91c4eaff724321d.jpg not downloaded yet
2026-03-30 09:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a24f71a0-7a84-5b1e-9645-d7bc5078f784 with identifier: MA00484
2026-03-30 09:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a24f71a0-7a84-5b1e-9645-d7bc5078f784 with identifier: MA00484
2026-03-30 09:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a24f71a0-7a84-5b1e-9645-d7bc5078f784 with identifier: MA00484 to the API
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:11:11Z',
 'fuel_type': 'diesel',
 'id': 'a24f71a0-7a84-5b1e-9645-d7bc5078f784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA00484',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 99652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-31',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2020}
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA00484%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Saving data for MA00484: {'auction_closing_time': 1774969871.0, 'created_time': 1773328257.701071, 'last_price_update_time': 1774861793.398158}
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MA00484') HTTP/1.1" 204 0
2026-03-30 09:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK89155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_4ac4885c2adff726bed64bba3247bc7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: DF99312
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: GJ96809
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: LS85229
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: AN76341
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: VN52677
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: KJ50164
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ50164%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Scrape type for KJ50164: 2
2026-03-30 09:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a495ea8-4c0a-58be-acb2-e9b2aba7eb79 with identifier: KJ50164
2026-03-30 09:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a495ea8-4c0a-58be-acb2-e9b2aba7eb79 with scrape type 2
2026-03-30 09:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a495ea8-4c0a-58be-acb2-e9b2aba7eb79 with scrape type 2
2026-03-30 09:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a495ea8-4c0a-58be-acb2-e9b2aba7eb79, identifier: KJ50164
2026-03-30 09:09:53 [auto1.it] INFO: Found listing with ID: AX03147
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX03147%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Scrape type for AX03147: 2
2026-03-30 09:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cb22d02-2007-562c-abaa-2df380c741c4 with identifier: AX03147
2026-03-30 09:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cb22d02-2007-562c-abaa-2df380c741c4 with scrape type 2
2026-03-30 09:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cb22d02-2007-562c-abaa-2df380c741c4 with scrape type 2
2026-03-30 09:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0cb22d02-2007-562c-abaa-2df380c741c4, identifier: AX03147
2026-03-30 09:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a495ea8-4c0a-58be-acb2-e9b2aba7eb79 with identifier: KJ50164
2026-03-30 09:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a495ea8-4c0a-58be-acb2-e9b2aba7eb79 with identifier: KJ50164
2026-03-30 09:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a495ea8-4c0a-58be-acb2-e9b2aba7eb79 with identifier: KJ50164 to the API
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:46:29Z',
 'fuel_type': 'diesel',
 'id': '6a495ea8-4c0a-58be-acb2-e9b2aba7eb79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ50164',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 110704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-11',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.5 Blue-HDi Grand Chic',
 'transmission': 'automatic',
 'trim': 'Grand Chic',
 'year': 2020}
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ50164%27 HTTP/1.1" 200 None
2026-03-30 09:09:53 [auto1.it] INFO: Saving data for KJ50164: {'auction_closing_time': 1774971989.0, 'created_time': 1774447552.582356, 'last_price_update_time': 1774861793.979729}
2026-03-30 09:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KJ50164') HTTP/1.1" 204 0
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_2c44713d1c0de04ce93397df20c1a0db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_2c44713d1c0de04ce93397df20c1a0db.jpg not downloaded yet
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_901816f514fde376a0a1f76001f36e0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_901816f514fde376a0a1f76001f36e0a.jpg not downloaded yet
2026-03-30 09:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0cb22d02-2007-562c-abaa-2df380c741c4 with identifier: AX03147
2026-03-30 09:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0cb22d02-2007-562c-abaa-2df380c741c4 with identifier: AX03147
2026-03-30 09:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0cb22d02-2007-562c-abaa-2df380c741c4 with identifier: AX03147 to the API
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 420,
 'expiration_date': '2026-03-31T15:20:25Z',
 'fuel_type': 'petrol',
 'id': '0cb22d02-2007-562c-abaa-2df380c741c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX03147',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 126004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-30',
 'seller_name': None,
 'title': 'Audi S6 4.0 V8 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX03147%27 HTTP/1.1" 200 None
2026-03-30 09:09:54 [auto1.it] INFO: Saving data for AX03147: {'auction_closing_time': 1774970425.0, 'created_time': 1773232271.540064, 'last_price_update_time': 1774861794.373221}
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AX03147') HTTP/1.1" 204 0
2026-03-30 09:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1324190>
2026-03-30 09:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_79829c6b002fc60f8557365cacce33e3.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_79829c6b002fc60f8557365cacce33e3.jpg saved to cache
2026-03-30 09:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d08b2cf-664e-54c1-8810-9c9360ab579b
2026-03-30 09:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10f7a10>
2026-03-30 09:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_98bf0963637fe4f42c432e3f2ecd01cf.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_98bf0963637fe4f42c432e3f2ecd01cf.jpg saved to cache
2026-03-30 09:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1675eec-006b-5c7e-be01-0691c6fd13ea
2026-03-30 09:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_588c849a08b2bab2b1ed8121fc451a31.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:54 [auto1.it] INFO: Found listing with ID: YM77442
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM77442%27 HTTP/1.1" 200 None
2026-03-30 09:09:54 [auto1.it] INFO: Scrape type for YM77442: 2
2026-03-30 09:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e6e04b0-a8d9-5cdd-a09f-967988ae5501 with identifier: YM77442
2026-03-30 09:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e6e04b0-a8d9-5cdd-a09f-967988ae5501 with scrape type 2
2026-03-30 09:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e6e04b0-a8d9-5cdd-a09f-967988ae5501 with scrape type 2
2026-03-30 09:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e6e04b0-a8d9-5cdd-a09f-967988ae5501, identifier: YM77442
2026-03-30 09:09:54 [auto1.it] INFO: Found listing with ID: SV06431
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV06431%27 HTTP/1.1" 200 None
2026-03-30 09:09:54 [auto1.it] INFO: Scrape type for SV06431: 1
2026-03-30 09:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_5423bff1538f19270aeaa02fd5bfa41b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e6e04b0-a8d9-5cdd-a09f-967988ae5501 with identifier: YM77442
2026-03-30 09:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e6e04b0-a8d9-5cdd-a09f-967988ae5501 with identifier: YM77442
2026-03-30 09:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e6e04b0-a8d9-5cdd-a09f-967988ae5501 with identifier: YM77442 to the API
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:22:41Z',
 'fuel_type': 'diesel',
 'id': '4e6e04b0-a8d9-5cdd-a09f-967988ae5501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM77442',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 78475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-11',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM77442%27 HTTP/1.1" 200 None
2026-03-30 09:09:54 [auto1.it] INFO: Saving data for YM77442: {'auction_closing_time': 1774970561.0, 'created_time': 1773131786.505904, 'last_price_update_time': 1774861794.989821}
2026-03-30 09:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YM77442') HTTP/1.1" 204 0
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_fe64908b8f0dd6cfe28f720d0aeae751.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_fe64908b8f0dd6cfe28f720d0aeae751.jpg not downloaded yet
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_75986d96d9ecdad418ad31caf4801014.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_75986d96d9ecdad418ad31caf4801014.jpg not downloaded yet
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee128c910>
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_231d3e1294e423fe9c1fddf3278ad145.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_231d3e1294e423fe9c1fddf3278ad145.jpg saved to cache
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d08b2cf-664e-54c1-8810-9c9360ab579b
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10b8e50>
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_4ac4885c2adff726bed64bba3247bc7b.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_4ac4885c2adff726bed64bba3247bc7b.jpg saved to cache
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10
2026-03-30 09:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_b05a4d2c57c65c943e495cdb80b07f03.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: HG08694
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG08694%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [auto1.it] INFO: Scrape type for HG08694: 2
2026-03-30 09:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1866f00f-1618-52c7-b1e8-d7eff08f1312 with identifier: HG08694
2026-03-30 09:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1866f00f-1618-52c7-b1e8-d7eff08f1312 with scrape type 2
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1866f00f-1618-52c7-b1e8-d7eff08f1312 with scrape type 2
2026-03-30 09:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1866f00f-1618-52c7-b1e8-d7eff08f1312, identifier: HG08694
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: AG39012
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: TA27022
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: TJ75613
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ75613%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [auto1.it] INFO: Scrape type for TJ75613: 1
2026-03-30 09:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_f06fcf7e113f513fc2d8a3e235f09ecd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1866f00f-1618-52c7-b1e8-d7eff08f1312 with identifier: HG08694
2026-03-30 09:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1866f00f-1618-52c7-b1e8-d7eff08f1312 with identifier: HG08694
2026-03-30 09:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1866f00f-1618-52c7-b1e8-d7eff08f1312 with identifier: HG08694 to the API
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:39:27Z',
 'fuel_type': 'petrol',
 'id': '1866f00f-1618-52c7-b1e8-d7eff08f1312',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG08694',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Paceman',
 'odometer': 136335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-09',
 'seller_name': None,
 'title': 'MINI Paceman Cooper S ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2014}
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG08694%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [auto1.it] INFO: Saving data for HG08694: {'auction_closing_time': 1774971567.0, 'created_time': 1774472760.907012, 'last_price_update_time': 1774861795.596287}
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG08694') HTTP/1.1" 204 0
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_1af707239346c611fc54c727b65e3147.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_1af707239346c611fc54c727b65e3147.jpg not downloaded yet
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_d7c051b38388d0f505f80c70cb4073cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_d7c051b38388d0f505f80c70cb4073cd.jpg not downloaded yet
2026-03-30 09:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_b86cea7c05a76fcf7a78375d963f856c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_cbeeddbab0aee4e90a03da5577156759.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: CY67116
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY67116%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [auto1.it] INFO: Scrape type for CY67116: 2
2026-03-30 09:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with identifier: CY67116
2026-03-30 09:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with scrape type 2
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with scrape type 2
2026-03-30 09:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff3ddc79-f5a9-52fa-a7f4-c82c56345913, identifier: CY67116
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: DC35918
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: CM69577
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: YV81257
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: SC87766
2026-03-30 09:09:55 [auto1.it] INFO: Found listing with ID: HW75415
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW75415%27 HTTP/1.1" 200 None
2026-03-30 09:09:55 [auto1.it] INFO: Scrape type for HW75415: 1
2026-03-30 09:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1276750>
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_588c849a08b2bab2b1ed8121fc451a31.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_588c849a08b2bab2b1ed8121fc451a31.jpg saved to cache
2026-03-30 09:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d08b2cf-664e-54c1-8810-9c9360ab579b
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12e6ad0>
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_5423bff1538f19270aeaa02fd5bfa41b.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_5423bff1538f19270aeaa02fd5bfa41b.jpg saved to cache
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10
2026-03-30 09:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_600b7335fd37112f3f915f168ca63f49.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_7f632c34ba8b74b0e91c4eaff724321d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with identifier: CY67116
2026-03-30 09:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with identifier: CY67116
2026-03-30 09:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff3ddc79-f5a9-52fa-a7f4-c82c56345913 with identifier: CY67116 to the API
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:46:09Z',
 'fuel_type': 'diesel',
 'id': 'ff3ddc79-f5a9-52fa-a7f4-c82c56345913',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY67116',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 49457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2020}
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY67116%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Saving data for CY67116: {'auction_closing_time': 1774971969.0, 'created_time': 1772655283.366951, 'last_price_update_time': 1774861796.408778}
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CY67116') HTTP/1.1" 204 0
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_340e75aad7ac4036ab03620672deb137.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_340e75aad7ac4036ab03620672deb137.jpg not downloaded yet
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_8e74be63725e9bf0f8466d9b7ce33190.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_8e74be63725e9bf0f8466d9b7ce33190.jpg not downloaded yet
2026-03-30 09:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_264bc7bffbeb617a17da21dcc44f99b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_fd70c99f2983fa416a5938095c95bd8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: CW72749
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW72749%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for CW72749: 2
2026-03-30 09:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with identifier: CW72749
2026-03-30 09:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with scrape type 2
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with scrape type 2
2026-03-30 09:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a, identifier: CW72749
2026-03-30 09:09:56 [auto1.it] INFO: Found listing with ID: NU75825
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU75825%27 HTTP/1.1" 200 None
2026-03-30 09:09:56 [auto1.it] INFO: Scrape type for NU75825: 2
2026-03-30 09:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccaa93fd-b1b5-56a8-9d3d-07e9afbf145a with identifier: NU75825
2026-03-30 09:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccaa93fd-b1b5-56a8-9d3d-07e9afbf145a with scrape type 2
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccaa93fd-b1b5-56a8-9d3d-07e9afbf145a with scrape type 2
2026-03-30 09:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ccaa93fd-b1b5-56a8-9d3d-07e9afbf145a, identifier: NU75825
2026-03-30 09:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25c1e50>
2026-03-30 09:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_b05a4d2c57c65c943e495cdb80b07f03.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_b05a4d2c57c65c943e495cdb80b07f03.jpg saved to cache
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1675eec-006b-5c7e-be01-0691c6fd13ea
2026-03-30 09:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee268b190>
2026-03-30 09:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_f06fcf7e113f513fc2d8a3e235f09ecd.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_f06fcf7e113f513fc2d8a3e235f09ecd.jpg saved to cache
2026-03-30 09:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d08b2cf-664e-54c1-8810-9c9360ab579b
2026-03-30 09:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_901816f514fde376a0a1f76001f36e0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_2c44713d1c0de04ce93397df20c1a0db.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with identifier: CW72749
2026-03-30 09:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with identifier: CW72749
2026-03-30 09:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a with identifier: CW72749 to the API
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:25:34Z',
 'fuel_type': 'diesel',
 'id': 'b7749d6e-ea5a-5ce9-8525-2dc2f23ecb8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW72749',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulia',
 'odometer': 220581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Alfa Romeo Giulia 2.2 JTDM Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2016}
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW72749%27 HTTP/1.1" 200 None
2026-03-30 09:09:57 [auto1.it] INFO: Saving data for CW72749: {'auction_closing_time': 1774970734.0, 'created_time': 1773695124.958412, 'last_price_update_time': 1774861797.264484}
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CW72749') HTTP/1.1" 204 0
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_0ac26d86ec41582fe2cc60ecfc845553.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_0ac26d86ec41582fe2cc60ecfc845553.jpg not downloaded yet
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_9b54c0ffca481e7d446f9715bdd681f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_9b54c0ffca481e7d446f9715bdd681f3.jpg not downloaded yet
2026-03-30 09:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ccaa93fd-b1b5-56a8-9d3d-07e9afbf145a with identifier: NU75825
2026-03-30 09:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ccaa93fd-b1b5-56a8-9d3d-07e9afbf145a with identifier: NU75825
2026-03-30 09:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ccaa93fd-b1b5-56a8-9d3d-07e9afbf145a with identifier: NU75825 to the API
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-31T15:58:35Z',
 'fuel_type': 'electro',
 'id': 'ccaa93fd-b1b5-56a8-9d3d-07e9afbf145a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU75825',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 33,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-28',
 'seller_name': None,
 'title': 'Lancia Ypsilon electric drive 115kW LX',
 'transmission': 'automatic',
 'trim': 'LX',
 'year': 2024}
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU75825%27 HTTP/1.1" 200 None
2026-03-30 09:09:57 [auto1.it] INFO: Saving data for NU75825: {'auction_closing_time': 1774972715.0, 'created_time': 1774559565.5255089, 'last_price_update_time': 1774861797.639614}
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NU75825') HTTP/1.1" 204 0
2026-03-30 09:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25a5490>
2026-03-30 09:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_b86cea7c05a76fcf7a78375d963f856c.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_b86cea7c05a76fcf7a78375d963f856c.jpg saved to cache
2026-03-30 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d08b2cf-664e-54c1-8810-9c9360ab579b
2026-03-30 09:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2826bd0>
2026-03-30 09:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_cbeeddbab0aee4e90a03da5577156759.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_cbeeddbab0aee4e90a03da5577156759.jpg saved to cache
2026-03-30 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1675eec-006b-5c7e-be01-0691c6fd13ea
2026-03-30 09:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_fe64908b8f0dd6cfe28f720d0aeae751.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_75986d96d9ecdad418ad31caf4801014.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: VZ97279
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: BL83628
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: RL69562
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: NR87302
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: VL00110
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL00110%27 HTTP/1.1" 200 None
2026-03-30 09:09:57 [auto1.it] INFO: Scrape type for VL00110: 2
2026-03-30 09:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62bd330e-459e-5ace-8936-36af84ea8d76 with identifier: VL00110
2026-03-30 09:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62bd330e-459e-5ace-8936-36af84ea8d76 with scrape type 2
2026-03-30 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62bd330e-459e-5ace-8936-36af84ea8d76 with scrape type 2
2026-03-30 09:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 62bd330e-459e-5ace-8936-36af84ea8d76, identifier: VL00110
2026-03-30 09:09:57 [auto1.it] INFO: Found listing with ID: KV08617
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV08617%27 HTTP/1.1" 200 None
2026-03-30 09:09:57 [auto1.it] INFO: Scrape type for KV08617: 2
2026-03-30 09:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70d0f7b6-a2e5-5abc-918a-78ff080069d0 with identifier: KV08617
2026-03-30 09:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d0f7b6-a2e5-5abc-918a-78ff080069d0 with scrape type 2
2026-03-30 09:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70d0f7b6-a2e5-5abc-918a-78ff080069d0 with scrape type 2
2026-03-30 09:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 70d0f7b6-a2e5-5abc-918a-78ff080069d0, identifier: KV08617
2026-03-30 09:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10876d0>
2026-03-30 09:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_600b7335fd37112f3f915f168ca63f49.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_600b7335fd37112f3f915f168ca63f49.jpg saved to cache
2026-03-30 09:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d08b2cf-664e-54c1-8810-9c9360ab579b
2026-03-30 09:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1127950>
2026-03-30 09:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_7f632c34ba8b74b0e91c4eaff724321d.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_7f632c34ba8b74b0e91c4eaff724321d.jpg saved to cache
2026-03-30 09:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10
2026-03-30 09:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_d7c051b38388d0f505f80c70cb4073cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 62bd330e-459e-5ace-8936-36af84ea8d76 with identifier: VL00110
2026-03-30 09:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 62bd330e-459e-5ace-8936-36af84ea8d76 with identifier: VL00110
2026-03-30 09:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 62bd330e-459e-5ace-8936-36af84ea8d76 with identifier: VL00110 to the API
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:51:45Z',
 'fuel_type': 'diesel',
 'id': '62bd330e-459e-5ace-8936-36af84ea8d76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL00110',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 175565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-15',
 'seller_name': None,
 'title': 'Audi A4 40 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2020}
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL00110%27 HTTP/1.1" 200 None
2026-03-30 09:09:58 [auto1.it] INFO: Saving data for VL00110: {'auction_closing_time': 1774972305.0, 'created_time': 1773695317.746443, 'last_price_update_time': 1774861798.545197}
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VL00110') HTTP/1.1" 204 0
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_0f5886c4bb5d3b3b8329a7d09ca39dad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_0f5886c4bb5d3b3b8329a7d09ca39dad.jpg not downloaded yet
2026-03-30 09:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 70d0f7b6-a2e5-5abc-918a-78ff080069d0 with identifier: KV08617
2026-03-30 09:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 70d0f7b6-a2e5-5abc-918a-78ff080069d0 with identifier: KV08617
2026-03-30 09:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 70d0f7b6-a2e5-5abc-918a-78ff080069d0 with identifier: KV08617 to the API
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-31T15:00:28Z',
 'fuel_type': 'petrol',
 'id': '70d0f7b6-a2e5-5abc-918a-78ff080069d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV08617',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 21666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-10',
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2024}
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV08617%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Saving data for KV08617: {'auction_closing_time': 1774969228.0, 'created_time': 1772705190.549325, 'last_price_update_time': 1774861799.068787}
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KV08617') HTTP/1.1" 204 0
2026-03-30 09:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_1af707239346c611fc54c727b65e3147.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: AW89631
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: MA00484
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA00484%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Scrape type for MA00484: 0
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: EZ12998
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: NX89211
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX89211%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Scrape type for NX89211: 1
2026-03-30 09:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ72891> (referer: https://www.auto1.com/v1/car-details-view/MJ72891/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:59 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-03-30 09:09:59 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-03-30 09:09:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:09:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-03-30 09:09:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-30 09:09:59 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-03-30 09:09:59 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:03:27 13:06:54\x00'
2026-03-30 09:09:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26755d0>
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F91%252Fef91507729021e49dd9b31d831d824ed%252Fpa%252FVZ29537_264bc7bffbeb617a17da21dcc44f99b4.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_264bc7bffbeb617a17da21dcc44f99b4.jpg saved to cache
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d08b2cf-664e-54c1-8810-9c9360ab579b
2026-03-30 09:09:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d08b2cf-664e-54c1-8810-9c9360ab579b, skipping ID generation
2026-03-30 09:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d08b2cf-664e-54c1-8810-9c9360ab579b with scrape type 1
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d08b2cf-664e-54c1-8810-9c9360ab579b sending to next pipeline
2026-03-30 09:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8d08b2cf-664e-54c1-8810-9c9360ab579b, identifier: VZ29537
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1007b90>
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_fd70c99f2983fa416a5938095c95bd8b.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_fd70c99f2983fa416a5938095c95bd8b.jpg saved to cache
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee133c210>
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_901816f514fde376a0a1f76001f36e0a.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_901816f514fde376a0a1f76001f36e0a.jpg saved to cache
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fa3590>
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_2c44713d1c0de04ce93397df20c1a0db.jpg') HTTP/1.1" 204 0
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_2c44713d1c0de04ce93397df20c1a0db.jpg saved to cache
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1675eec-006b-5c7e-be01-0691c6fd13ea
2026-03-30 09:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_340e75aad7ac4036ab03620672deb137.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8d08b2cf-664e-54c1-8810-9c9360ab579b with identifier: VZ29537
2026-03-30 09:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8d08b2cf-664e-54c1-8810-9c9360ab579b with identifier: VZ29537
2026-03-30 09:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8d08b2cf-664e-54c1-8810-9c9360ab579b with identifier: VZ29537 to the API
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_264bc7bffbeb617a17da21dcc44f99b4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:01:16Z',
 'fuel_type': 'diesel',
 'id': '8d08b2cf-664e-54c1-8810-9c9360ab579b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ29537',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 60702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 909679,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_79829c6b002fc60f8557365cacce33e3.jpg',
             'Width': 1943},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_a91b4ccecdd9bb28c17a3b5cb9f952dc.jpg',
             'Width': 759},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_6c0ace9d9669bac2ea96cc7bd1e1f3c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_9fd28cba698c72965d0ddc050015869e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 952953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_f06fcf7e113f513fc2d8a3e235f09ecd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 953217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_b86cea7c05a76fcf7a78375d963f856c.jpg',
             'Width': 1942},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 826093,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_600b7335fd37112f3f915f168ca63f49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 793168,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_264bc7bffbeb617a17da21dcc44f99b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_231d3e1294e423fe9c1fddf3278ad145.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d08b2cf-664e-54c1-8810-9c9360ab579b/8d08b2cf-664e-54c1-8810-9c9360ab579b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/91/ef91507729021e49dd9b31d831d824ed/pa/VZ29537_588c849a08b2bab2b1ed8121fc451a31.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 2.0 M-Jet Limited 4WD',
 'transmission': 'manual',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ29537%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Saving data for VZ29537: {'created_time': 1774861799.854782, 'last_price_update_time': 1774861799.854792, 'auction_closing_time': 1774969276.0}
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VZ29537') HTTP/1.1" 204 0
2026-03-30 09:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_8e74be63725e9bf0f8466d9b7ce33190.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: BV47322
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: PR82970
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: NN24552
2026-03-30 09:09:59 [auto1.it] INFO: Found listing with ID: DD47357
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD47357%27 HTTP/1.1" 200 None
2026-03-30 09:09:59 [auto1.it] INFO: Scrape type for DD47357: 2
2026-03-30 09:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac7460e-e0a8-5899-8c1e-7fa3ef26af02 with identifier: DD47357
2026-03-30 09:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac7460e-e0a8-5899-8c1e-7fa3ef26af02 with scrape type 2
2026-03-30 09:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aac7460e-e0a8-5899-8c1e-7fa3ef26af02 with scrape type 2
2026-03-30 09:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aac7460e-e0a8-5899-8c1e-7fa3ef26af02, identifier: DD47357
2026-03-30 09:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU50076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee254a090>
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_fe64908b8f0dd6cfe28f720d0aeae751.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_fe64908b8f0dd6cfe28f720d0aeae751.jpg saved to cache
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1675eec-006b-5c7e-be01-0691c6fd13ea
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee255fd50>
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_75986d96d9ecdad418ad31caf4801014.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_75986d96d9ecdad418ad31caf4801014.jpg saved to cache
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1377bd0>
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_d7c051b38388d0f505f80c70cb4073cd.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_d7c051b38388d0f505f80c70cb4073cd.jpg saved to cache
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10
2026-03-30 09:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aac7460e-e0a8-5899-8c1e-7fa3ef26af02 with identifier: DD47357
2026-03-30 09:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aac7460e-e0a8-5899-8c1e-7fa3ef26af02 with identifier: DD47357
2026-03-30 09:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aac7460e-e0a8-5899-8c1e-7fa3ef26af02 with identifier: DD47357 to the API
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:08:55Z',
 'fuel_type': 'diesel',
 'id': 'aac7460e-e0a8-5899-8c1e-7fa3ef26af02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD47357',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 187430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-27',
 'seller_name': None,
 'title': 'Jeep Compass 2.2 CRD Limited 4x2',
 'transmission': 'manual',
 'trim': 'Limited 4x2',
 'year': 2011}
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD47357%27 HTTP/1.1" 200 None
2026-03-30 09:10:00 [auto1.it] INFO: Saving data for DD47357: {'auction_closing_time': 1774969735.0, 'created_time': 1774343154.587117, 'last_price_update_time': 1774861800.521899}
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DD47357') HTTP/1.1" 204 0
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1377a10>
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_1af707239346c611fc54c727b65e3147.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_1af707239346c611fc54c727b65e3147.jpg saved to cache
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1675eec-006b-5c7e-be01-0691c6fd13ea
2026-03-30 09:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd08bea-f06f-5843-94ae-964f5487c82f with identifier: MJ72891
2026-03-30 09:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd08bea-f06f-5843-94ae-964f5487c82f with scrape type 1
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5bd08bea-f06f-5843-94ae-964f5487c82f
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_ef73a114f8622d828b02bf90530fe2d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_ef73a114f8622d828b02bf90530fe2d6.jpg not downloaded yet
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: GE66634
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: EC84156
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC84156%27 HTTP/1.1" 200 None
2026-03-30 09:10:00 [auto1.it] INFO: Scrape type for EC84156: 1
2026-03-30 09:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV06431/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1478650>
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_340e75aad7ac4036ab03620672deb137.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_340e75aad7ac4036ab03620672deb137.jpg saved to cache
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1675eec-006b-5c7e-be01-0691c6fd13ea
2026-03-30 09:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_0f5886c4bb5d3b3b8329a7d09ca39dad.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_9b54c0ffca481e7d446f9715bdd681f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_d37640f6fb98cab08be33ca0b4df2aad.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_d37640f6fb98cab08be33ca0b4df2aad.jpg not downloaded yet
2026-03-30 09:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK89155> (referer: https://www.auto1.com/v1/car-details-view/FK89155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee260d450>
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_8e74be63725e9bf0f8466d9b7ce33190.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_8e74be63725e9bf0f8466d9b7ce33190.jpg saved to cache
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10
2026-03-30 09:10:00 [auto1.it] INFO: Channel: 24h | Page: 19 | totalHits: 3307 | hits on page: 40
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: MJ25258
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: WD60231
2026-03-30 09:10:00 [auto1.it] INFO: Found listing with ID: DX69970
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX69970%27 HTTP/1.1" 200 None
2026-03-30 09:10:00 [auto1.it] INFO: Scrape type for DX69970: 2
2026-03-30 09:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 873fa915-a719-5d46-b5b2-5f4c2340b3de with identifier: DX69970
2026-03-30 09:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 873fa915-a719-5d46-b5b2-5f4c2340b3de with scrape type 2
2026-03-30 09:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 873fa915-a719-5d46-b5b2-5f4c2340b3de with scrape type 2
2026-03-30 09:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 873fa915-a719-5d46-b5b2-5f4c2340b3de, identifier: DX69970
2026-03-30 09:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 873fa915-a719-5d46-b5b2-5f4c2340b3de with identifier: DX69970
2026-03-30 09:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 873fa915-a719-5d46-b5b2-5f4c2340b3de with identifier: DX69970
2026-03-30 09:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 873fa915-a719-5d46-b5b2-5f4c2340b3de with identifier: DX69970 to the API
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:22:03Z',
 'fuel_type': 'electro',
 'id': '873fa915-a719-5d46-b5b2-5f4c2340b3de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX69970',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2026-02-24',
 'seller_name': None,
 'title': 'Peugeot 208 electric drive 100 kW e Active',
 'transmission': 'automatic',
 'trim': 'e Active',
 'year': 2026}
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX69970%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [auto1.it] INFO: Saving data for DX69970: {'auction_closing_time': 1774970523.0, 'created_time': 1774516053.836809, 'last_price_update_time': 1774861801.217957}
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DX69970') HTTP/1.1" 204 0
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_b01ecadac40a7f7a369485c3247dace3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_b01ecadac40a7f7a369485c3247dace3.jpg not downloaded yet
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: BG92234
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: UA98347
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: HP60897
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP60897%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [auto1.it] INFO: Scrape type for HP60897: 2
2026-03-30 09:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 350a86fa-1fea-5a0a-8fcf-b6eba910bf19 with identifier: HP60897
2026-03-30 09:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 350a86fa-1fea-5a0a-8fcf-b6eba910bf19 with scrape type 2
2026-03-30 09:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 350a86fa-1fea-5a0a-8fcf-b6eba910bf19 with scrape type 2
2026-03-30 09:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 350a86fa-1fea-5a0a-8fcf-b6eba910bf19, identifier: HP60897
2026-03-30 09:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: SY68388
2026-03-30 09:10:01 [auto1.it] INFO: Found listing with ID: KA52665
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA52665%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [auto1.it] INFO: Scrape type for KA52665: 1
2026-03-30 09:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 350a86fa-1fea-5a0a-8fcf-b6eba910bf19 with identifier: HP60897
2026-03-30 09:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 350a86fa-1fea-5a0a-8fcf-b6eba910bf19 with identifier: HP60897
2026-03-30 09:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 350a86fa-1fea-5a0a-8fcf-b6eba910bf19 with identifier: HP60897 to the API
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-31T15:03:52Z',
 'fuel_type': 'petrol',
 'id': '350a86fa-1fea-5a0a-8fcf-b6eba910bf19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP60897',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3 Sportback',
 'odometer': 29446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': None,
 'title': 'Audi S3 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP60897%27 HTTP/1.1" 200 None
2026-03-30 09:10:01 [auto1.it] INFO: Saving data for HP60897: {'auction_closing_time': 1774969432.0, 'created_time': 1774354477.627872, 'last_price_update_time': 1774861801.84419}
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HP60897') HTTP/1.1" 204 0
2026-03-30 09:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1410490>
2026-03-30 09:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_0f5886c4bb5d3b3b8329a7d09ca39dad.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_0f5886c4bb5d3b3b8329a7d09ca39dad.jpg saved to cache
2026-03-30 09:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10
2026-03-30 09:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27054d0>
2026-03-30 09:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F06%252F3206a4ace16c8115cd4434d703d8138d%252Fpa%252FLS46243_9b54c0ffca481e7d446f9715bdd681f3.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_9b54c0ffca481e7d446f9715bdd681f3.jpg saved to cache
2026-03-30 09:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10
2026-03-30 09:10:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17eeae6e-d20c-58f6-a5e5-a37bc88acb10, skipping ID generation
2026-03-30 09:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10 with scrape type 1
2026-03-30 09:10:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17eeae6e-d20c-58f6-a5e5-a37bc88acb10 sending to next pipeline
2026-03-30 09:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17eeae6e-d20c-58f6-a5e5-a37bc88acb10, identifier: LS46243
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_c415f29afe34d9de9c107f549e5443eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_c415f29afe34d9de9c107f549e5443eb.jpg not downloaded yet
2026-03-30 09:10:02 [auto1.it] INFO: Found listing with ID: LY78924
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY78924%27 HTTP/1.1" 200 None
2026-03-30 09:10:02 [auto1.it] INFO: Scrape type for LY78924: 1
2026-03-30 09:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17eeae6e-d20c-58f6-a5e5-a37bc88acb10 with identifier: LS46243
2026-03-30 09:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17eeae6e-d20c-58f6-a5e5-a37bc88acb10 with identifier: LS46243
2026-03-30 09:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 17eeae6e-d20c-58f6-a5e5-a37bc88acb10 with identifier: LS46243 to the API
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_9b54c0ffca481e7d446f9715bdd681f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.1L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:50:35Z',
 'fuel_type': 'diesel',
 'id': '17eeae6e-d20c-58f6-a5e5-a37bc88acb10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS46243',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 296364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_4ac4885c2adff726bed64bba3247bc7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_5423bff1538f19270aeaa02fd5bfa41b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_fd70c99f2983fa416a5938095c95bd8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_7f632c34ba8b74b0e91c4eaff724321d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_901816f514fde376a0a1f76001f36e0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_75986d96d9ecdad418ad31caf4801014.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_d7c051b38388d0f505f80c70cb4073cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_8e74be63725e9bf0f8466d9b7ce33190.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_9b54c0ffca481e7d446f9715bdd681f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eeae6e-d20c-58f6-a5e5-a37bc88acb10/17eeae6e-d20c-58f6-a5e5-a37bc88acb10_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/06/3206a4ace16c8115cd4434d703d8138d/pa/LS46243_0f5886c4bb5d3b3b8329a7d09ca39dad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Lusso',
 'transmission': 'automatic',
 'trim': 'Q4 Lusso',
 'year': 2019}
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS46243%27 HTTP/1.1" 200 None
2026-03-30 09:10:02 [auto1.it] INFO: Saving data for LS46243: {'created_time': 1774861802.459336, 'last_price_update_time': 1774861802.459354, 'auction_closing_time': 1774972235.0}
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LS46243') HTTP/1.1" 204 0
2026-03-30 09:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_ef73a114f8622d828b02bf90530fe2d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:02 [auto1.it] INFO: Found listing with ID: HL79864
2026-03-30 09:10:02 [auto1.it] INFO: Found listing with ID: TM51427
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM51427%27 HTTP/1.1" 200 None
2026-03-30 09:10:02 [auto1.it] INFO: Scrape type for TM51427: 2
2026-03-30 09:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9f1a8fc-8097-5581-9893-990d7e30ed7e with identifier: TM51427
2026-03-30 09:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f1a8fc-8097-5581-9893-990d7e30ed7e with scrape type 2
2026-03-30 09:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9f1a8fc-8097-5581-9893-990d7e30ed7e with scrape type 2
2026-03-30 09:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b9f1a8fc-8097-5581-9893-990d7e30ed7e, identifier: TM51427
2026-03-30 09:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW75415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fc42a3c-7472-506c-8304-a10185c92c68 with identifier: FK89155
2026-03-30 09:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc42a3c-7472-506c-8304-a10185c92c68 with scrape type 1
2026-03-30 09:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7fc42a3c-7472-506c-8304-a10185c92c68
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F70%252Fe9707b3d13c2c1f89e8122179a889811%252Fpa%252FFK89155_5eea605a7ea52221063f5e274713320c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_5eea605a7ea52221063f5e274713320c.jpg not downloaded yet
2026-03-30 09:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b9f1a8fc-8097-5581-9893-990d7e30ed7e with identifier: TM51427
2026-03-30 09:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b9f1a8fc-8097-5581-9893-990d7e30ed7e with identifier: TM51427
2026-03-30 09:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b9f1a8fc-8097-5581-9893-990d7e30ed7e with identifier: TM51427 to the API
2026-03-30 09:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-31T15:45:38Z',
 'fuel_type': 'electro',
 'id': 'b9f1a8fc-8097-5581-9893-990d7e30ed7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM51427',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 58,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2026-02-24',
 'seller_name': None,
 'title': 'Peugeot 2008 electric drive 115 kW Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2026}
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM51427%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [auto1.it] INFO: Saving data for TM51427: {'auction_closing_time': 1774971938.0, 'created_time': 1774516052.664251, 'last_price_update_time': 1774861803.29472}
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TM51427') HTTP/1.1" 204 0
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_177f40aebb7feb3f868063ccee2c51d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_177f40aebb7feb3f868063ccee2c51d1.jpg not downloaded yet
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: PZ75115
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: GN40589
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN40589%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [auto1.it] INFO: Scrape type for GN40589: 1
2026-03-30 09:10:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_d37640f6fb98cab08be33ca0b4df2aad.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: NT07416
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: LY93977
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: EY61657
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY61657%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [auto1.it] INFO: Scrape type for EY61657: 2
2026-03-30 09:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79397c5a-0f2a-55e9-b587-6e5662913737 with identifier: EY61657
2026-03-30 09:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79397c5a-0f2a-55e9-b587-6e5662913737 with scrape type 2
2026-03-30 09:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79397c5a-0f2a-55e9-b587-6e5662913737 with scrape type 2
2026-03-30 09:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 79397c5a-0f2a-55e9-b587-6e5662913737, identifier: EY61657
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F70%252Fe9707b3d13c2c1f89e8122179a889811%252Fpa%252FFK89155_6a5ce464efcff39cac4622695f19cf9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_6a5ce464efcff39cac4622695f19cf9e.jpg not downloaded yet
2026-03-30 09:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 79397c5a-0f2a-55e9-b587-6e5662913737 with identifier: EY61657
2026-03-30 09:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 79397c5a-0f2a-55e9-b587-6e5662913737 with identifier: EY61657
2026-03-30 09:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 79397c5a-0f2a-55e9-b587-6e5662913737 with identifier: EY61657 to the API
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-31T15:15:34Z',
 'fuel_type': 'electro',
 'id': '79397c5a-0f2a-55e9-b587-6e5662913737',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY61657',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2026-02-24',
 'seller_name': None,
 'title': 'Peugeot 2008 electric drive 115 kW Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2026}
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY61657%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [auto1.it] INFO: Saving data for EY61657: {'auction_closing_time': 1774970134.0, 'created_time': 1774516027.087444, 'last_price_update_time': 1774861803.865398}
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EY61657') HTTP/1.1" 204 0
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_8a746da684bd277a30ca680d475b1e96.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_8a746da684bd277a30ca680d475b1e96.jpg not downloaded yet
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: ET82005
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: UR67041
2026-03-30 09:10:03 [auto1.it] INFO: Found listing with ID: XY85045
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY85045%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [auto1.it] INFO: Scrape type for XY85045: 1
2026-03-30 09:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee254b5d0>
2026-03-30 09:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_ef73a114f8622d828b02bf90530fe2d6.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_ef73a114f8622d828b02bf90530fe2d6.jpg saved to cache
2026-03-30 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bd08bea-f06f-5843-94ae-964f5487c82f
2026-03-30 09:10:04 [auto1.it] INFO: Found listing with ID: WV93749
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV93749%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [auto1.it] INFO: Scrape type for WV93749: 1
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F70%252Fe9707b3d13c2c1f89e8122179a889811%252Fpa%252FFK89155_da159da289faf39799059ecb04fde9a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_da159da289faf39799059ecb04fde9a0.jpg not downloaded yet
2026-03-30 09:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX89211/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_c415f29afe34d9de9c107f549e5443eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_b01ecadac40a7f7a369485c3247dace3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_785e7a0b50e7f9d07ea014522550f50c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_785e7a0b50e7f9d07ea014522550f50c.jpg not downloaded yet
2026-03-30 09:10:04 [auto1.it] INFO: Found listing with ID: ZH20956
2026-03-30 09:10:04 [auto1.it] INFO: Found listing with ID: HK60927
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK60927%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [auto1.it] INFO: Scrape type for HK60927: 2
2026-03-30 09:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2092c01-4674-5479-8bf1-fc76081bedc1 with identifier: HK60927
2026-03-30 09:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2092c01-4674-5479-8bf1-fc76081bedc1 with scrape type 2
2026-03-30 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2092c01-4674-5479-8bf1-fc76081bedc1 with scrape type 2
2026-03-30 09:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c2092c01-4674-5479-8bf1-fc76081bedc1, identifier: HK60927
2026-03-30 09:10:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:04 [scrapy.extensions.logstats] INFO: Crawled 218 pages (at 22 pages/min), scraped 357 items (at 92 items/min)
2026-03-30 09:10:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 09:10:04 [auto1.it] INFO: Found listing with ID: NR03781
2026-03-30 09:10:04 [auto1.it] INFO: Found listing with ID: XX43378
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX43378%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [auto1.it] INFO: Scrape type for XX43378: 2
2026-03-30 09:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaa5fc2f-256f-5b58-8027-e4549f47f293 with identifier: XX43378
2026-03-30 09:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaa5fc2f-256f-5b58-8027-e4549f47f293 with scrape type 2
2026-03-30 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaa5fc2f-256f-5b58-8027-e4549f47f293 with scrape type 2
2026-03-30 09:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eaa5fc2f-256f-5b58-8027-e4549f47f293, identifier: XX43378
2026-03-30 09:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c2092c01-4674-5479-8bf1-fc76081bedc1 with identifier: HK60927
2026-03-30 09:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c2092c01-4674-5479-8bf1-fc76081bedc1 with identifier: HK60927
2026-03-30 09:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c2092c01-4674-5479-8bf1-fc76081bedc1 with identifier: HK60927 to the API
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:42:51Z',
 'fuel_type': 'diesel',
 'id': 'c2092c01-4674-5479-8bf1-fc76081bedc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK60927',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 119437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Business BlueMotion Tech',
 'year': 2016}
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK60927%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [auto1.it] INFO: Saving data for HK60927: {'auction_closing_time': 1774971771.0, 'created_time': 1772783975.153539, 'last_price_update_time': 1774861804.733473}
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HK60927') HTTP/1.1" 204 0
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F70%252Fe9707b3d13c2c1f89e8122179a889811%252Fpa%252FFK89155_780ef42aa9931550b7d949418e6230f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_780ef42aa9931550b7d949418e6230f0.jpg not downloaded yet
2026-03-30 09:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48d7150>
2026-03-30 09:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_d37640f6fb98cab08be33ca0b4df2aad.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_d37640f6fb98cab08be33ca0b4df2aad.jpg saved to cache
2026-03-30 09:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bd08bea-f06f-5843-94ae-964f5487c82f
2026-03-30 09:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_5eea605a7ea52221063f5e274713320c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eaa5fc2f-256f-5b58-8027-e4549f47f293 with identifier: XX43378
2026-03-30 09:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eaa5fc2f-256f-5b58-8027-e4549f47f293 with identifier: XX43378
2026-03-30 09:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eaa5fc2f-256f-5b58-8027-e4549f47f293 with identifier: XX43378 to the API
2026-03-30 09:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:07:37Z',
 'fuel_type': 'diesel',
 'id': 'eaa5fc2f-256f-5b58-8027-e4549f47f293',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX43378',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 162025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-03',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 Autobiography',
 'transmission': 'automatic',
 'trim': 'Autobiography',
 'year': 2017}
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX43378%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Saving data for XX43378: {'auction_closing_time': 1774969657.0, 'created_time': 1774343142.670184, 'last_price_update_time': 1774861805.377214}
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX43378') HTTP/1.1" 204 0
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_27f5fec9d2b2504f9c5058dec865e6c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_27f5fec9d2b2504f9c5058dec865e6c6.jpg not downloaded yet
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: BD18129
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: UY94009
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY94009%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Scrape type for UY94009: 2
2026-03-30 09:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 497c4a6d-0c12-571c-af45-32d9248618d0 with identifier: UY94009
2026-03-30 09:10:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 497c4a6d-0c12-571c-af45-32d9248618d0 with scrape type 2
2026-03-30 09:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 497c4a6d-0c12-571c-af45-32d9248618d0 with scrape type 2
2026-03-30 09:10:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 497c4a6d-0c12-571c-af45-32d9248618d0, identifier: UY94009
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: HW21830
2026-03-30 09:10:05 [auto1.it] INFO: Found listing with ID: DJ29974
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ29974%27 HTTP/1.1" 200 None
2026-03-30 09:10:05 [auto1.it] INFO: Scrape type for DJ29974: 1
2026-03-30 09:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 497c4a6d-0c12-571c-af45-32d9248618d0 with identifier: UY94009
2026-03-30 09:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 497c4a6d-0c12-571c-af45-32d9248618d0 with identifier: UY94009
2026-03-30 09:10:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 497c4a6d-0c12-571c-af45-32d9248618d0 with identifier: UY94009 to the API
2026-03-30 09:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-31T15:17:54Z',
 'fuel_type': 'petrol',
 'id': '497c4a6d-0c12-571c-af45-32d9248618d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY94009',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 4',
 'odometer': 171830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': None,
 'title': 'Audi RS 4 2.9 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY94009%27 HTTP/1.1" 200 None
2026-03-30 09:10:06 [auto1.it] INFO: Saving data for UY94009: {'auction_closing_time': 1774970274.0, 'created_time': 1774300308.748247, 'last_price_update_time': 1774861806.187032}
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UY94009') HTTP/1.1" 204 0
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F70%252Fe9707b3d13c2c1f89e8122179a889811%252Fpa%252FFK89155_87f7ad5e9f63f33fc8baf94d44d1bf99.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_87f7ad5e9f63f33fc8baf94d44d1bf99.jpg not downloaded yet
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee45e3e50>
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_c415f29afe34d9de9c107f549e5443eb.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_c415f29afe34d9de9c107f549e5443eb.jpg saved to cache
2026-03-30 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bd08bea-f06f-5843-94ae-964f5487c82f
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1374650>
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_b01ecadac40a7f7a369485c3247dace3.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_b01ecadac40a7f7a369485c3247dace3.jpg saved to cache
2026-03-30 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bd08bea-f06f-5843-94ae-964f5487c82f
2026-03-30 09:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_177f40aebb7feb3f868063ccee2c51d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_212976e3e116266e6af6ea15aaee48c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_212976e3e116266e6af6ea15aaee48c3.jpg not downloaded yet
2026-03-30 09:10:06 [auto1.it] INFO: Found listing with ID: PP36077
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP36077%27 HTTP/1.1" 200 None
2026-03-30 09:10:06 [auto1.it] INFO: Scrape type for PP36077: 1
2026-03-30 09:10:06 [auto1.it] INFO: Found listing with ID: AK22038
2026-03-30 09:10:06 [auto1.it] INFO: Found listing with ID: KH48340
2026-03-30 09:10:06 [auto1.it] INFO: Found listing with ID: BV67922
2026-03-30 09:10:06 [auto1.it] INFO: Found listing with ID: FJ09980
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ09980%27 HTTP/1.1" 200 None
2026-03-30 09:10:06 [auto1.it] INFO: Scrape type for FJ09980: 2
2026-03-30 09:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61672fd5-97eb-5171-9435-2e79eea06531 with identifier: FJ09980
2026-03-30 09:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61672fd5-97eb-5171-9435-2e79eea06531 with scrape type 2
2026-03-30 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61672fd5-97eb-5171-9435-2e79eea06531 with scrape type 2
2026-03-30 09:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61672fd5-97eb-5171-9435-2e79eea06531, identifier: FJ09980
2026-03-30 09:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU50076> (referer: https://www.auto1.com/v1/car-details-view/SU50076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ75613/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27f9890>
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc42a3c-7472-506c-8304-a10185c92c68/7fc42a3c-7472-506c-8304-a10185c92c68_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F70%252Fe9707b3d13c2c1f89e8122179a889811%252Fpa%252FFK89155_5eea605a7ea52221063f5e274713320c.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_5eea605a7ea52221063f5e274713320c.jpg saved to cache
2026-03-30 09:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fc42a3c-7472-506c-8304-a10185c92c68
2026-03-30 09:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_da159da289faf39799059ecb04fde9a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61672fd5-97eb-5171-9435-2e79eea06531 with identifier: FJ09980
2026-03-30 09:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61672fd5-97eb-5171-9435-2e79eea06531 with identifier: FJ09980
2026-03-30 09:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61672fd5-97eb-5171-9435-2e79eea06531 with identifier: FJ09980 to the API
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:45:14Z',
 'fuel_type': 'diesel',
 'id': '61672fd5-97eb-5171-9435-2e79eea06531',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ09980',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 125407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-21',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 Blue-HDi 335 L2H2 Premium Stop&Start',
 'transmission': 'manual',
 'trim': '335 L2H2 Premium Stop&Start',
 'year': 2021}
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ09980%27 HTTP/1.1" 200 None
2026-03-30 09:10:07 [auto1.it] INFO: Saving data for FJ09980: {'auction_closing_time': 1774971914.0, 'created_time': 1774354699.504621, 'last_price_update_time': 1774861807.093899}
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ09980') HTTP/1.1" 204 0
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_611c25f308ca3ac6cb38bc525f79b6d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_611c25f308ca3ac6cb38bc525f79b6d7.jpg not downloaded yet
2026-03-30 09:10:07 [auto1.it] INFO: Found listing with ID: AY28860
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY28860%27 HTTP/1.1" 200 None
2026-03-30 09:10:07 [auto1.it] INFO: Scrape type for AY28860: 1
2026-03-30 09:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_785e7a0b50e7f9d07ea014522550f50c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:07 [auto1.it] INFO: Found listing with ID: LE83570
2026-03-30 09:10:07 [auto1.it] INFO: Found listing with ID: RG24184
2026-03-30 09:10:07 [auto1.it] INFO: Found listing with ID: KU84675
2026-03-30 09:10:07 [auto1.it] INFO: Found listing with ID: BW30944
2026-03-30 09:10:07 [auto1.it] INFO: Found listing with ID: CV26562
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV26562%27 HTTP/1.1" 200 None
2026-03-30 09:10:07 [auto1.it] INFO: Scrape type for CV26562: 2
2026-03-30 09:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562
2026-03-30 09:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with scrape type 2
2026-03-30 09:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with scrape type 2
2026-03-30 09:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b, identifier: CV26562
2026-03-30 09:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_27f5fec9d2b2504f9c5058dec865e6c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562
2026-03-30 09:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562
2026-03-30 09:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b with identifier: CV26562 to the API
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:09:50Z',
 'fuel_type': 'petrol',
 'id': 'b5e50b26-ba35-5aa8-b9f1-7fc9459cef2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV26562',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 36904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TFSI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV26562%27 HTTP/1.1" 200 None
2026-03-30 09:10:07 [auto1.it] INFO: Saving data for CV26562: {'auction_closing_time': 1774969790.0, 'created_time': 1774473160.375644, 'last_price_update_time': 1774861807.767071}
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV26562') HTTP/1.1" 204 0
2026-03-30 09:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA52665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2574990>
2026-03-30 09:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_177f40aebb7feb3f868063ccee2c51d1.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_177f40aebb7feb3f868063ccee2c51d1.jpg saved to cache
2026-03-30 09:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bd08bea-f06f-5843-94ae-964f5487c82f
2026-03-30 09:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf6f6848-44e0-51c1-b028-2efa867b935c with identifier: SU50076
2026-03-30 09:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf6f6848-44e0-51c1-b028-2efa867b935c with scrape type 1
2026-03-30 09:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf6f6848-44e0-51c1-b028-2efa867b935c
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_31d56279a07b4f5112b20cf7eb81a75e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_31d56279a07b4f5112b20cf7eb81a75e.jpg not downloaded yet
2026-03-30 09:10:07 [auto1.it] INFO: Channel: 24h | Page: 20 | totalHits: 3309 | hits on page: 40
2026-03-30 09:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fe9650>
2026-03-30 09:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc42a3c-7472-506c-8304-a10185c92c68/7fc42a3c-7472-506c-8304-a10185c92c68_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F70%252Fe9707b3d13c2c1f89e8122179a889811%252Fpa%252FFK89155_da159da289faf39799059ecb04fde9a0.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_da159da289faf39799059ecb04fde9a0.jpg saved to cache
2026-03-30 09:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fc42a3c-7472-506c-8304-a10185c92c68
2026-03-30 09:10:07 [auto1.it] INFO: Found listing with ID: YH66131
2026-03-30 09:10:07 [auto1.it] INFO: Found listing with ID: WU70120
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU70120%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for WU70120: 2
2026-03-30 09:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35932ef3-d5c6-54c4-95e4-98f21cef330f with identifier: WU70120
2026-03-30 09:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35932ef3-d5c6-54c4-95e4-98f21cef330f with scrape type 2
2026-03-30 09:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35932ef3-d5c6-54c4-95e4-98f21cef330f with scrape type 2
2026-03-30 09:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 35932ef3-d5c6-54c4-95e4-98f21cef330f, identifier: WU70120
2026-03-30 09:10:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_d20c88b28432246604192cccdc298f59.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 35932ef3-d5c6-54c4-95e4-98f21cef330f with identifier: WU70120
2026-03-30 09:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 35932ef3-d5c6-54c4-95e4-98f21cef330f with identifier: WU70120
2026-03-30 09:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 35932ef3-d5c6-54c4-95e4-98f21cef330f with identifier: WU70120 to the API
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:21:59Z',
 'fuel_type': 'diesel',
 'id': '35932ef3-d5c6-54c4-95e4-98f21cef330f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU70120',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 95313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-19',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 M-Jet Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2017}
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU70120%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Saving data for WU70120: {'auction_closing_time': 1774970519.0, 'created_time': 1772866196.649164, 'last_price_update_time': 1774861808.559336}
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WU70120') HTTP/1.1" 204 0
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_4186c0696d75c1e42fb3d4917f77a08b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_4186c0696d75c1e42fb3d4917f77a08b.jpg not downloaded yet
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: JT53783
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT53783%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for JT53783: 1
2026-03-30 09:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY78924/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee14506d0>
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_785e7a0b50e7f9d07ea014522550f50c.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_785e7a0b50e7f9d07ea014522550f50c.jpg saved to cache
2026-03-30 09:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bd08bea-f06f-5843-94ae-964f5487c82f
2026-03-30 09:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_212976e3e116266e6af6ea15aaee48c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_87f7ad5e9f63f33fc8baf94d44d1bf99.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: TH98415
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH98415%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for TH98415: 1
2026-03-30 09:10:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee283d550>
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_27f5fec9d2b2504f9c5058dec865e6c6.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_27f5fec9d2b2504f9c5058dec865e6c6.jpg saved to cache
2026-03-30 09:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bd08bea-f06f-5843-94ae-964f5487c82f
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_f47e2643a2b98b1a95fbb46ea8b765b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_f47e2643a2b98b1a95fbb46ea8b765b3.jpg not downloaded yet
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: PK93114
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK93114%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for PK93114: 1
2026-03-30 09:10:08 [auto1.it] INFO: Found listing with ID: LE69865
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE69865%27 HTTP/1.1" 200 None
2026-03-30 09:10:08 [auto1.it] INFO: Scrape type for LE69865: 2
2026-03-30 09:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f810854-3f77-5e36-b244-efe5f23869de with identifier: LE69865
2026-03-30 09:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f810854-3f77-5e36-b244-efe5f23869de with scrape type 2
2026-03-30 09:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f810854-3f77-5e36-b244-efe5f23869de with scrape type 2
2026-03-30 09:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f810854-3f77-5e36-b244-efe5f23869de, identifier: LE69865
2026-03-30 09:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN40589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee280f610>
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_d20c88b28432246604192cccdc298f59.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_d20c88b28432246604192cccdc298f59.jpg saved to cache
2026-03-30 09:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1675eec-006b-5c7e-be01-0691c6fd13ea
2026-03-30 09:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f810854-3f77-5e36-b244-efe5f23869de with identifier: LE69865
2026-03-30 09:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f810854-3f77-5e36-b244-efe5f23869de with identifier: LE69865
2026-03-30 09:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f810854-3f77-5e36-b244-efe5f23869de with identifier: LE69865 to the API
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:16:36Z',
 'fuel_type': 'diesel',
 'id': '3f810854-3f77-5e36-b244-efe5f23869de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE69865',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 126467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2017}
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE69865%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Saving data for LE69865: {'auction_closing_time': 1774970196.0, 'created_time': 1772866130.147458, 'last_price_update_time': 1774861809.433335}
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LE69865') HTTP/1.1" 204 0
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_ec70981e528d94b518e9ba512d7276cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_ec70981e528d94b518e9ba512d7276cd.jpg not downloaded yet
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: HS60673
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: GB15509
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: YF83888
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: NM97698
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: WC79116
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC79116%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for WC79116: 1
2026-03-30 09:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_611c25f308ca3ac6cb38bc525f79b6d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_31d56279a07b4f5112b20cf7eb81a75e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_780ef42aa9931550b7d949418e6230f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: AA15878
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA15878%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for AA15878: 1
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_31a608055aa2230aa7bec5f6afe64adc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_31a608055aa2230aa7bec5f6afe64adc.jpg not downloaded yet
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: GA22711
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: KT64542
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: VJ15098
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: BP75996
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: YP88006
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP88006%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for YP88006: 1
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1134590>
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_212976e3e116266e6af6ea15aaee48c3.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_212976e3e116266e6af6ea15aaee48c3.jpg saved to cache
2026-03-30 09:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bd08bea-f06f-5843-94ae-964f5487c82f
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1107e50>
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc42a3c-7472-506c-8304-a10185c92c68/7fc42a3c-7472-506c-8304-a10185c92c68_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F70%252Fe9707b3d13c2c1f89e8122179a889811%252Fpa%252FFK89155_87f7ad5e9f63f33fc8baf94d44d1bf99.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_87f7ad5e9f63f33fc8baf94d44d1bf99.jpg saved to cache
2026-03-30 09:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fc42a3c-7472-506c-8304-a10185c92c68
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: VF67541
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF67541%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for VF67541: 1
2026-03-30 09:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC84156/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_a56388de33b6d7f54c4803517dae345f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_a56388de33b6d7f54c4803517dae345f.jpg not downloaded yet
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: DA03444
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA03444%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for DA03444: 1
2026-03-30 09:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:09 [auto1.it] INFO: Found listing with ID: DS14351
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS14351%27 HTTP/1.1" 200 None
2026-03-30 09:10:09 [auto1.it] INFO: Scrape type for DS14351: 2
2026-03-30 09:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18f7f18a-bc0e-5f10-9281-51361e285f4b with identifier: DS14351
2026-03-30 09:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18f7f18a-bc0e-5f10-9281-51361e285f4b with scrape type 2
2026-03-30 09:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18f7f18a-bc0e-5f10-9281-51361e285f4b with scrape type 2
2026-03-30 09:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18f7f18a-bc0e-5f10-9281-51361e285f4b, identifier: DS14351
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2544590>
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_611c25f308ca3ac6cb38bc525f79b6d7.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_611c25f308ca3ac6cb38bc525f79b6d7.jpg saved to cache
2026-03-30 09:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bd08bea-f06f-5843-94ae-964f5487c82f
2026-03-30 09:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1246810>
2026-03-30 09:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_31d56279a07b4f5112b20cf7eb81a75e.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_31d56279a07b4f5112b20cf7eb81a75e.jpg saved to cache
2026-03-30 09:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf6f6848-44e0-51c1-b028-2efa867b935c
2026-03-30 09:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2640550>
2026-03-30 09:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc42a3c-7472-506c-8304-a10185c92c68/7fc42a3c-7472-506c-8304-a10185c92c68_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F70%252Fe9707b3d13c2c1f89e8122179a889811%252Fpa%252FFK89155_780ef42aa9931550b7d949418e6230f0.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_780ef42aa9931550b7d949418e6230f0.jpg saved to cache
2026-03-30 09:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fc42a3c-7472-506c-8304-a10185c92c68
2026-03-30 09:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_90d0753f6173149b4b03962e65334950.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_ec70981e528d94b518e9ba512d7276cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18f7f18a-bc0e-5f10-9281-51361e285f4b with identifier: DS14351
2026-03-30 09:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18f7f18a-bc0e-5f10-9281-51361e285f4b with identifier: DS14351
2026-03-30 09:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18f7f18a-bc0e-5f10-9281-51361e285f4b with identifier: DS14351 to the API
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:13:51Z',
 'fuel_type': 'petrol',
 'id': '18f7f18a-bc0e-5f10-9281-51361e285f4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS14351',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 172485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-04',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2010}
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS14351%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Saving data for DS14351: {'auction_closing_time': 1774970031.0, 'created_time': 1772866361.290971, 'last_price_update_time': 1774861810.584301}
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DS14351') HTTP/1.1" 204 0
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_704bc7802ee63b9456be5aa0db0047f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_704bc7802ee63b9456be5aa0db0047f4.jpg not downloaded yet
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: ZJ84308
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ84308%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for ZJ84308: 2
2026-03-30 09:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d26a8190-09a8-5205-8888-ec54fae4c14b with identifier: ZJ84308
2026-03-30 09:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d26a8190-09a8-5205-8888-ec54fae4c14b with scrape type 2
2026-03-30 09:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d26a8190-09a8-5205-8888-ec54fae4c14b with scrape type 2
2026-03-30 09:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d26a8190-09a8-5205-8888-ec54fae4c14b, identifier: ZJ84308
2026-03-30 09:10:10 [auto1.it] INFO: Found listing with ID: RA39852
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA39852%27 HTTP/1.1" 200 None
2026-03-30 09:10:10 [auto1.it] INFO: Scrape type for RA39852: 2
2026-03-30 09:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4af00978-dc48-5601-8110-c485700df46e with identifier: RA39852
2026-03-30 09:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af00978-dc48-5601-8110-c485700df46e with scrape type 2
2026-03-30 09:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4af00978-dc48-5601-8110-c485700df46e with scrape type 2
2026-03-30 09:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4af00978-dc48-5601-8110-c485700df46e, identifier: RA39852
2026-03-30 09:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d26a8190-09a8-5205-8888-ec54fae4c14b with identifier: ZJ84308
2026-03-30 09:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d26a8190-09a8-5205-8888-ec54fae4c14b with identifier: ZJ84308
2026-03-30 09:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d26a8190-09a8-5205-8888-ec54fae4c14b with identifier: ZJ84308 to the API
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:40:12Z',
 'fuel_type': 'gas',
 'id': 'd26a8190-09a8-5205-8888-ec54fae4c14b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ84308',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 205741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 LPG Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2019}
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ84308%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Saving data for ZJ84308: {'auction_closing_time': 1774971612.0, 'created_time': 1773132330.983115, 'last_price_update_time': 1774861811.558622}
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZJ84308') HTTP/1.1" 204 0
2026-03-30 09:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4af00978-dc48-5601-8110-c485700df46e with identifier: RA39852
2026-03-30 09:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4af00978-dc48-5601-8110-c485700df46e with identifier: RA39852
2026-03-30 09:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4af00978-dc48-5601-8110-c485700df46e with identifier: RA39852 to the API
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:16:42Z',
 'fuel_type': 'diesel',
 'id': '4af00978-dc48-5601-8110-c485700df46e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA39852',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 141082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-30',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 JTD Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA39852%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Saving data for RA39852: {'auction_closing_time': 1774970202.0, 'created_time': 1772866183.850893, 'last_price_update_time': 1774861811.898013}
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA39852') HTTP/1.1" 204 0
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_0cb6a07d92e5e718c6e4cdfad12fd3c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_0cb6a07d92e5e718c6e4cdfad12fd3c0.jpg not downloaded yet
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: JX77984
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: WA94787
2026-03-30 09:10:11 [auto1.it] INFO: Found listing with ID: AN65635
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN65635%27 HTTP/1.1" 200 None
2026-03-30 09:10:11 [auto1.it] INFO: Scrape type for AN65635: 2
2026-03-30 09:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce7e0250-071f-55e9-9714-101fbbdf6de8 with identifier: AN65635
2026-03-30 09:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce7e0250-071f-55e9-9714-101fbbdf6de8 with scrape type 2
2026-03-30 09:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce7e0250-071f-55e9-9714-101fbbdf6de8 with scrape type 2
2026-03-30 09:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ce7e0250-071f-55e9-9714-101fbbdf6de8, identifier: AN65635
2026-03-30 09:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW75415> (referer: https://www.auto1.com/v1/car-details-view/HW75415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: LG90075
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: SB84815
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: RV29599
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: AP46989
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP46989%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for AP46989: 1
2026-03-30 09:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ce7e0250-071f-55e9-9714-101fbbdf6de8 with identifier: AN65635
2026-03-30 09:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ce7e0250-071f-55e9-9714-101fbbdf6de8 with identifier: AN65635
2026-03-30 09:10:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ce7e0250-071f-55e9-9714-101fbbdf6de8 with identifier: AN65635 to the API
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:01:04Z',
 'fuel_type': 'diesel',
 'id': 'ce7e0250-071f-55e9-9714-101fbbdf6de8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN65635',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 254605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2019}
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN65635%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Saving data for AN65635: {'auction_closing_time': 1774969264.0, 'created_time': 1774267573.269642, 'last_price_update_time': 1774861812.368805}
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AN65635') HTTP/1.1" 204 0
2026-03-30 09:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_a56388de33b6d7f54c4803517dae345f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_9aca8a553b45fbcd65c9f303ff242500.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_9aca8a553b45fbcd65c9f303ff242500.jpg not downloaded yet
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: ER60323
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: ZC12877
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: YT71636
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT71636%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for YT71636: 2
2026-03-30 09:10:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5adc5d48-4d9f-52f8-b56d-7dadf93e22d2 with identifier: YT71636
2026-03-30 09:10:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5adc5d48-4d9f-52f8-b56d-7dadf93e22d2 with scrape type 2
2026-03-30 09:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5adc5d48-4d9f-52f8-b56d-7dadf93e22d2 with scrape type 2
2026-03-30 09:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5adc5d48-4d9f-52f8-b56d-7dadf93e22d2, identifier: YT71636
2026-03-30 09:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV06431> (referer: https://www.auto1.com/v1/car-details-view/SV06431/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1246490>
2026-03-30 09:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_90d0753f6173149b4b03962e65334950.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_90d0753f6173149b4b03962e65334950.jpg saved to cache
2026-03-30 09:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1675eec-006b-5c7e-be01-0691c6fd13ea
2026-03-30 09:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1430490>
2026-03-30 09:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_ec70981e528d94b518e9ba512d7276cd.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_ec70981e528d94b518e9ba512d7276cd.jpg saved to cache
2026-03-30 09:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf6f6848-44e0-51c1-b028-2efa867b935c
2026-03-30 09:10:12 [auto1.it] INFO: Found listing with ID: DC14157
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC14157%27 HTTP/1.1" 200 None
2026-03-30 09:10:12 [auto1.it] INFO: Scrape type for DC14157: 1
2026-03-30 09:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5adc5d48-4d9f-52f8-b56d-7dadf93e22d2 with identifier: YT71636
2026-03-30 09:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5adc5d48-4d9f-52f8-b56d-7dadf93e22d2 with identifier: YT71636
2026-03-30 09:10:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5adc5d48-4d9f-52f8-b56d-7dadf93e22d2 with identifier: YT71636 to the API
2026-03-30 09:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:03:04Z',
 'fuel_type': 'petrol',
 'id': '5adc5d48-4d9f-52f8-b56d-7dadf93e22d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT71636',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 57504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': None,
 'title': 'BMW X2 sDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT71636%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Saving data for YT71636: {'auction_closing_time': 1774969384.0, 'created_time': 1774094795.577096, 'last_price_update_time': 1774861813.23277}
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YT71636') HTTP/1.1" 204 0
2026-03-30 09:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_5d6e606f49c21b74790d4a98102296dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_5d6e606f49c21b74790d4a98102296dc.jpg not downloaded yet
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: TC55039
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: TT29802
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT29802%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for TT29802: 1
2026-03-30 09:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX89211> (referer: https://www.auto1.com/v1/car-details-view/NX89211/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV93749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: SY71538
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY71538%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for SY71538: 1
2026-03-30 09:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP36077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ29974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bedc3cb-6301-56d7-9e4a-6d805fe99e85 with identifier: HW75415
2026-03-30 09:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85 with scrape type 1
2026-03-30 09:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_b39a9a409f4a8d453937db7955411c32.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_b39a9a409f4a8d453937db7955411c32.jpg not downloaded yet
2026-03-30 09:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2503b90>
2026-03-30 09:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_a56388de33b6d7f54c4803517dae345f.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_a56388de33b6d7f54c4803517dae345f.jpg saved to cache
2026-03-30 09:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf6f6848-44e0-51c1-b028-2efa867b935c
2026-03-30 09:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0152a889-6a7a-5468-9b1c-d1e66eede67f with identifier: SV06431
2026-03-30 09:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0152a889-6a7a-5468-9b1c-d1e66eede67f with scrape type 1
2026-03-30 09:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0152a889-6a7a-5468-9b1c-d1e66eede67f
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_aa3009271e5457f88bcc052ae22671a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_aa3009271e5457f88bcc052ae22671a6.jpg not downloaded yet
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: WG32639
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG32639%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for WG32639: 2
2026-03-30 09:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4770794-1a02-5105-a990-d89c18e59441 with identifier: WG32639
2026-03-30 09:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4770794-1a02-5105-a990-d89c18e59441 with scrape type 2
2026-03-30 09:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4770794-1a02-5105-a990-d89c18e59441 with scrape type 2
2026-03-30 09:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4770794-1a02-5105-a990-d89c18e59441, identifier: WG32639
2026-03-30 09:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_0cb6a07d92e5e718c6e4cdfad12fd3c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: TV97878
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: DY67923
2026-03-30 09:10:13 [auto1.it] INFO: Found listing with ID: DU03202
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU03202%27 HTTP/1.1" 200 None
2026-03-30 09:10:13 [auto1.it] INFO: Scrape type for DU03202: 2
2026-03-30 09:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c40dbc6-065a-5f28-b329-8f587b786b38 with identifier: DU03202
2026-03-30 09:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c40dbc6-065a-5f28-b329-8f587b786b38 with scrape type 2
2026-03-30 09:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c40dbc6-065a-5f28-b329-8f587b786b38 with scrape type 2
2026-03-30 09:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c40dbc6-065a-5f28-b329-8f587b786b38, identifier: DU03202
2026-03-30 09:10:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4770794-1a02-5105-a990-d89c18e59441 with identifier: WG32639
2026-03-30 09:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4770794-1a02-5105-a990-d89c18e59441 with identifier: WG32639
2026-03-30 09:10:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4770794-1a02-5105-a990-d89c18e59441 with identifier: WG32639 to the API
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:20:42Z',
 'fuel_type': 'diesel',
 'id': 'b4770794-1a02-5105-a990-d89c18e59441',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG32639',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 84921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2020}
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG32639%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Saving data for WG32639: {'auction_closing_time': 1774970442.0, 'created_time': 1774472767.26453, 'last_price_update_time': 1774861814.384073}
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WG32639') HTTP/1.1" 204 0
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_8f542cd7df98d0f6da0a9dd4a8426d76.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_8f542cd7df98d0f6da0a9dd4a8426d76.jpg not downloaded yet
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_accdd46df6b6fe60c3316b80d6a2da0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_accdd46df6b6fe60c3316b80d6a2da0e.jpg not downloaded yet
2026-03-30 09:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_0ac26d86ec41582fe2cc60ecfc845553.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c40dbc6-065a-5f28-b329-8f587b786b38 with identifier: DU03202
2026-03-30 09:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c40dbc6-065a-5f28-b329-8f587b786b38 with identifier: DU03202
2026-03-30 09:10:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c40dbc6-065a-5f28-b329-8f587b786b38 with identifier: DU03202 to the API
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:13:43Z',
 'fuel_type': 'diesel',
 'id': '2c40dbc6-065a-5f28-b329-8f587b786b38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU03202',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 199522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-16',
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM SX',
 'transmission': 'automatic',
 'trim': 'SX',
 'year': 2013}
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU03202%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Saving data for DU03202: {'auction_closing_time': 1774970023.0, 'created_time': 1773136058.820918, 'last_price_update_time': 1774861814.784918}
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DU03202') HTTP/1.1" 204 0
2026-03-30 09:10:14 [auto1.it] INFO: Found listing with ID: DT03603
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT03603%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [auto1.it] INFO: Scrape type for DT03603: 2
2026-03-30 09:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea0be8b4-a22d-53e4-ab99-faa47e6e1267 with identifier: DT03603
2026-03-30 09:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea0be8b4-a22d-53e4-ab99-faa47e6e1267 with scrape type 2
2026-03-30 09:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea0be8b4-a22d-53e4-ab99-faa47e6e1267 with scrape type 2
2026-03-30 09:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea0be8b4-a22d-53e4-ab99-faa47e6e1267, identifier: DT03603
2026-03-30 09:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209d4fdc-b7cb-5747-85a1-80b626300200 with identifier: NX89211
2026-03-30 09:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209d4fdc-b7cb-5747-85a1-80b626300200 with scrape type 1
2026-03-30 09:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 209d4fdc-b7cb-5747-85a1-80b626300200
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F79%252F9979e21ad5aff9a5727d52aa62501372%252Fpa%252FNX89211_9a1fa0c1d9b988eb1bf9069940c04551.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_9a1fa0c1d9b988eb1bf9069940c04551.jpg already downloaded
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F79%252F9979e21ad5aff9a5727d52aa62501372%252Fpa%252FNX89211_9180589b54ce4427e18328aeffe31270.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_9180589b54ce4427e18328aeffe31270.jpg already downloaded
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F79%252F9979e21ad5aff9a5727d52aa62501372%252Fpa%252FNX89211_fcfa1e694e22d8fbc4a7e6b4006212c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_fcfa1e694e22d8fbc4a7e6b4006212c6.jpg already downloaded
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F79%252F9979e21ad5aff9a5727d52aa62501372%252Fpa%252FNX89211_7492e144f79027e84c0b354ac76f6fe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_7492e144f79027e84c0b354ac76f6fe4.jpg already downloaded
2026-03-30 09:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F79%252F9979e21ad5aff9a5727d52aa62501372%252Fpa%252FNX89211_f879538bb1f1d39b496f3aedce6fc460.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_f879538bb1f1d39b496f3aedce6fc460.jpg already downloaded
2026-03-30 09:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 209d4fdc-b7cb-5747-85a1-80b626300200, identifier: NX89211
2026-03-30 09:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_9aca8a553b45fbcd65c9f303ff242500.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:15 [auto1.it] INFO: Found listing with ID: RL27846
2026-03-30 09:10:15 [auto1.it] INFO: Found listing with ID: JT53783
2026-03-30 09:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea0be8b4-a22d-53e4-ab99-faa47e6e1267 with identifier: DT03603
2026-03-30 09:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea0be8b4-a22d-53e4-ab99-faa47e6e1267 with identifier: DT03603
2026-03-30 09:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea0be8b4-a22d-53e4-ab99-faa47e6e1267 with identifier: DT03603 to the API
2026-03-30 09:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:56:28Z',
 'fuel_type': 'diesel',
 'id': 'ea0be8b4-a22d-53e4-ab99-faa47e6e1267',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT03603',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 101625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Admired',
 'transmission': 'automatic',
 'trim': 'Admired',
 'year': 2014}
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT03603%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Saving data for DT03603: {'auction_closing_time': 1774972588.0, 'created_time': 1774645833.56242, 'last_price_update_time': 1774861816.064615}
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DT03603') HTTP/1.1" 204 0
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_61f9917f9702cfa42947053ae4de80e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_61f9917f9702cfa42947053ae4de80e2.jpg not downloaded yet
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_c7a29e1e201634655cd1339d67f94ddd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_c7a29e1e201634655cd1339d67f94ddd.jpg not downloaded yet
2026-03-30 09:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 209d4fdc-b7cb-5747-85a1-80b626300200 with identifier: NX89211
2026-03-30 09:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 209d4fdc-b7cb-5747-85a1-80b626300200 with identifier: NX89211
2026-03-30 09:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 209d4fdc-b7cb-5747-85a1-80b626300200 with identifier: NX89211 to the API
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NX89211>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:32:32Z',
 'fuel_type': 'petrol',
 'id': '209d4fdc-b7cb-5747-85a1-80b626300200',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX89211',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 147884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_9a1fa0c1d9b988eb1bf9069940c04551.jpg',
                'https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_9180589b54ce4427e18328aeffe31270.jpg',
                'https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_fcfa1e694e22d8fbc4a7e6b4006212c6.jpg',
                'https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_7492e144f79027e84c0b354ac76f6fe4.jpg',
                'https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_f879538bb1f1d39b496f3aedce6fc460.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209d4fdc-b7cb-5747-85a1-80b626300200/209d4fdc-b7cb-5747-85a1-80b626300200_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_9a1fa0c1d9b988eb1bf9069940c04551.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209d4fdc-b7cb-5747-85a1-80b626300200/209d4fdc-b7cb-5747-85a1-80b626300200_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_9180589b54ce4427e18328aeffe31270.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209d4fdc-b7cb-5747-85a1-80b626300200/209d4fdc-b7cb-5747-85a1-80b626300200_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_fcfa1e694e22d8fbc4a7e6b4006212c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209d4fdc-b7cb-5747-85a1-80b626300200/209d4fdc-b7cb-5747-85a1-80b626300200_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_7492e144f79027e84c0b354ac76f6fe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_209d4fdc-b7cb-5747-85a1-80b626300200/209d4fdc-b7cb-5747-85a1-80b626300200_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/79/9979e21ad5aff9a5727d52aa62501372/pa/NX89211_f879538bb1f1d39b496f3aedce6fc460.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Modus 1.2 Attractive',
 'transmission': 'manual',
 'trim': 'Attractive',
 'year': 2011}
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX89211%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Saving data for NX89211: {'created_time': 1774861816.465115, 'last_price_update_time': 1774861816.465128, 'auction_closing_time': 1774971152.0}
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NX89211') HTTP/1.1" 204 0
2026-03-30 09:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_5d6e606f49c21b74790d4a98102296dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: BW92200
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: JJ00308
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ00308%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for JJ00308: 1
2026-03-30 09:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ75613> (referer: https://www.auto1.com/v1/car-details-view/TJ75613/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13b97d0>
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_0cb6a07d92e5e718c6e4cdfad12fd3c0.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_0cb6a07d92e5e718c6e4cdfad12fd3c0.jpg saved to cache
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf6f6848-44e0-51c1-b028-2efa867b935c
2026-03-30 09:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_aa3009271e5457f88bcc052ae22671a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: PK93114
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_655020a324534d0be49f4122ec47576d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_655020a324534d0be49f4122ec47576d.jpg not downloaded yet
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_e074db75e63a03896c3b3531055e7ac8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_e074db75e63a03896c3b3531055e7ac8.jpg not downloaded yet
2026-03-30 09:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:16 [auto1.it] INFO: Found listing with ID: SM78375
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM78375%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [auto1.it] INFO: Scrape type for SM78375: 1
2026-03-30 09:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY28860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11634d0>
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F42%252F1d42b7d31db57d012f4d5e95d0524228%252Fpa%252FWV48837_0ac26d86ec41582fe2cc60ecfc845553.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_0ac26d86ec41582fe2cc60ecfc845553.jpg saved to cache
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1675eec-006b-5c7e-be01-0691c6fd13ea
2026-03-30 09:10:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1675eec-006b-5c7e-be01-0691c6fd13ea, skipping ID generation
2026-03-30 09:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1675eec-006b-5c7e-be01-0691c6fd13ea with scrape type 1
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1675eec-006b-5c7e-be01-0691c6fd13ea sending to next pipeline
2026-03-30 09:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1675eec-006b-5c7e-be01-0691c6fd13ea, identifier: WV48837
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1160a50>
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_9aca8a553b45fbcd65c9f303ff242500.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_9aca8a553b45fbcd65c9f303ff242500.jpg saved to cache
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf6f6848-44e0-51c1-b028-2efa867b935c
2026-03-30 09:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_accdd46df6b6fe60c3316b80d6a2da0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_b39a9a409f4a8d453937db7955411c32.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_78967709b75c0c2f71daedb82552ddf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_78967709b75c0c2f71daedb82552ddf6.jpg not downloaded yet
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_3d7fdcaa325ffbe7b6fe0efc25cbd023.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_3d7fdcaa325ffbe7b6fe0efc25cbd023.jpg not downloaded yet
2026-03-30 09:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1675eec-006b-5c7e-be01-0691c6fd13ea with identifier: WV48837
2026-03-30 09:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1675eec-006b-5c7e-be01-0691c6fd13ea with identifier: WV48837
2026-03-30 09:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1675eec-006b-5c7e-be01-0691c6fd13ea with identifier: WV48837 to the API
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_0ac26d86ec41582fe2cc60ecfc845553.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:02:09Z',
 'fuel_type': 'petrol',
 'id': 'f1675eec-006b-5c7e-be01-0691c6fd13ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV48837',
 'listing': 'auction',
 'location': 'IT, Vigevano',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 84707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_98bf0963637fe4f42c432e3f2ecd01cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2581013,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_d20c88b28432246604192cccdc298f59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_b05a4d2c57c65c943e495cdb80b07f03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_cbeeddbab0aee4e90a03da5577156759.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610837,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_90d0753f6173149b4b03962e65334950.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_2c44713d1c0de04ce93397df20c1a0db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_fe64908b8f0dd6cfe28f720d0aeae751.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_1af707239346c611fc54c727b65e3147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_340e75aad7ac4036ab03620672deb137.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1675eec-006b-5c7e-be01-0691c6fd13ea/f1675eec-006b-5c7e-be01-0691c6fd13ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2773196,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/42/1d42b7d31db57d012f4d5e95d0524228/pa/WV48837_0ac26d86ec41582fe2cc60ecfc845553.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X-Cite',
 'transmission': 'manual',
 'trim': 'X-Cite',
 'year': 2016}
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV48837%27 HTTP/1.1" 200 None
2026-03-30 09:10:17 [auto1.it] INFO: Saving data for WV48837: {'created_time': 1774861817.36117, 'last_price_update_time': 1774861817.361183, 'auction_closing_time': 1774969329.0}
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WV48837') HTTP/1.1" 204 0
2026-03-30 09:10:17 [auto1.it] INFO: Found listing with ID: XV63353
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV63353%27 HTTP/1.1" 200 None
2026-03-30 09:10:17 [auto1.it] INFO: Scrape type for XV63353: 2
2026-03-30 09:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5c034fb-c698-5942-bfb4-88fc7464b760 with identifier: XV63353
2026-03-30 09:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5c034fb-c698-5942-bfb4-88fc7464b760 with scrape type 2
2026-03-30 09:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5c034fb-c698-5942-bfb4-88fc7464b760 with scrape type 2
2026-03-30 09:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d5c034fb-c698-5942-bfb4-88fc7464b760, identifier: XV63353
2026-03-30 09:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24c6710>
2026-03-30 09:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_5d6e606f49c21b74790d4a98102296dc.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_5d6e606f49c21b74790d4a98102296dc.jpg saved to cache
2026-03-30 09:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf6f6848-44e0-51c1-b028-2efa867b935c
2026-03-30 09:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9 with identifier: TJ75613
2026-03-30 09:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9 with scrape type 1
2026-03-30 09:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_84c04a93893c9efa5403bc95c62b7f7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_84c04a93893c9efa5403bc95c62b7f7d.jpg not downloaded yet
2026-03-30 09:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d5c034fb-c698-5942-bfb4-88fc7464b760 with identifier: XV63353
2026-03-30 09:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d5c034fb-c698-5942-bfb4-88fc7464b760 with identifier: XV63353
2026-03-30 09:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d5c034fb-c698-5942-bfb4-88fc7464b760 with identifier: XV63353 to the API
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:49:38Z',
 'fuel_type': 'petrol',
 'id': 'd5c034fb-c698-5942-bfb4-88fc7464b760',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV63353',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 9648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-07-27',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2025}
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV63353%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Saving data for XV63353: {'auction_closing_time': 1774972178.0, 'created_time': 1774613148.526478, 'last_price_update_time': 1774861818.070201}
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV63353') HTTP/1.1" 204 0
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_c3aa9e193433e4d0d15239132121bf1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_c3aa9e193433e4d0d15239132121bf1b.jpg not downloaded yet
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_8f5b0fa76267c19e197d40a01179308b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_8f5b0fa76267c19e197d40a01179308b.jpg not downloaded yet
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24fbe90>
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_aa3009271e5457f88bcc052ae22671a6.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_aa3009271e5457f88bcc052ae22671a6.jpg saved to cache
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0152a889-6a7a-5468-9b1c-d1e66eede67f
2026-03-30 09:10:18 [auto1.it] INFO: Channel: 24h | Page: 21 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_c7a29e1e201634655cd1339d67f94ddd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: AF62726
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF62726%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for AF62726: 2
2026-03-30 09:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0662f2ef-b4b7-5072-a9f2-51d7e4badf37 with identifier: AF62726
2026-03-30 09:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0662f2ef-b4b7-5072-a9f2-51d7e4badf37 with scrape type 2
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0662f2ef-b4b7-5072-a9f2-51d7e4badf37 with scrape type 2
2026-03-30 09:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0662f2ef-b4b7-5072-a9f2-51d7e4badf37, identifier: AF62726
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_221f3756b4b9fa3fb74727e95ac67af1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_221f3756b4b9fa3fb74727e95ac67af1.jpg not downloaded yet
2026-03-30 09:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC79116/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK93114/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY78924> (referer: https://www.auto1.com/v1/car-details-view/LY78924/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee254abd0>
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_accdd46df6b6fe60c3316b80d6a2da0e.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_accdd46df6b6fe60c3316b80d6a2da0e.jpg saved to cache
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0152a889-6a7a-5468-9b1c-d1e66eede67f
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2827390>
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_b39a9a409f4a8d453937db7955411c32.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_b39a9a409f4a8d453937db7955411c32.jpg saved to cache
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85
2026-03-30 09:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_e074db75e63a03896c3b3531055e7ac8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0662f2ef-b4b7-5072-a9f2-51d7e4badf37 with identifier: AF62726
2026-03-30 09:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0662f2ef-b4b7-5072-a9f2-51d7e4badf37 with identifier: AF62726
2026-03-30 09:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0662f2ef-b4b7-5072-a9f2-51d7e4badf37 with identifier: AF62726 to the API
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:12:03Z',
 'fuel_type': 'diesel',
 'id': '0662f2ef-b4b7-5072-a9f2-51d7e4badf37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF62726',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 284657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF62726%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Saving data for AF62726: {'auction_closing_time': 1774969923.0, 'created_time': 1773135723.431392, 'last_price_update_time': 1774861818.784267}
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF62726') HTTP/1.1" 204 0
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_a7184153e064079544f8520ce96091a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_a7184153e064079544f8520ce96091a2.jpg not downloaded yet
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_b8596ba1d3fdafa6bf473d147c79703a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_b8596ba1d3fdafa6bf473d147c79703a.jpg not downloaded yet
2026-03-30 09:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: GB25673
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: VP57623
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: RF81077
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: TB87558
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: BG63942
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: FP39081
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: JK72241
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: SV47237
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV47237%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for SV47237: 2
2026-03-30 09:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e512df9-d66a-596a-be63-3a8b8c520ba5 with identifier: SV47237
2026-03-30 09:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e512df9-d66a-596a-be63-3a8b8c520ba5 with scrape type 2
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e512df9-d66a-596a-be63-3a8b8c520ba5 with scrape type 2
2026-03-30 09:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e512df9-d66a-596a-be63-3a8b8c520ba5, identifier: SV47237
2026-03-30 09:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_655020a324534d0be49f4122ec47576d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_61f9917f9702cfa42947053ae4de80e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: JK19998
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: AA77653
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: PC98849
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: ZH14156
2026-03-30 09:10:18 [auto1.it] INFO: Found listing with ID: MW39681
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW39681%27 HTTP/1.1" 200 None
2026-03-30 09:10:18 [auto1.it] INFO: Scrape type for MW39681: 2
2026-03-30 09:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5ab35f-95b4-5ac0-8fa0-07e3caa848e7 with identifier: MW39681
2026-03-30 09:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5ab35f-95b4-5ac0-8fa0-07e3caa848e7 with scrape type 2
2026-03-30 09:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5ab35f-95b4-5ac0-8fa0-07e3caa848e7 with scrape type 2
2026-03-30 09:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf5ab35f-95b4-5ac0-8fa0-07e3caa848e7, identifier: MW39681
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_ef2d8286c0bbbb2fb2a9a6838ac08247.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_ef2d8286c0bbbb2fb2a9a6838ac08247.jpg not downloaded yet
2026-03-30 09:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e512df9-d66a-596a-be63-3a8b8c520ba5 with identifier: SV47237
2026-03-30 09:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e512df9-d66a-596a-be63-3a8b8c520ba5 with identifier: SV47237
2026-03-30 09:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e512df9-d66a-596a-be63-3a8b8c520ba5 with identifier: SV47237 to the API
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:35:35Z',
 'fuel_type': 'diesel',
 'id': '4e512df9-d66a-596a-be63-3a8b8c520ba5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV47237',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 50666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-15',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 HDi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2011}
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV47237%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Saving data for SV47237: {'auction_closing_time': 1774971335.0, 'created_time': 1772608447.910171, 'last_price_update_time': 1774861819.473834}
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SV47237') HTTP/1.1" 204 0
2026-03-30 09:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf5ab35f-95b4-5ac0-8fa0-07e3caa848e7 with identifier: MW39681
2026-03-30 09:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf5ab35f-95b4-5ac0-8fa0-07e3caa848e7 with identifier: MW39681
2026-03-30 09:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf5ab35f-95b4-5ac0-8fa0-07e3caa848e7 with identifier: MW39681 to the API
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-31T15:30:55Z',
 'fuel_type': 'hybrid',
 'id': 'bf5ab35f-95b4-5ac0-8fa0-07e3caa848e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW39681',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 102193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-16',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2023}
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW39681%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Saving data for MW39681: {'auction_closing_time': 1774971055.0, 'created_time': 1774354342.643554, 'last_price_update_time': 1774861819.909118}
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MW39681') HTTP/1.1" 204 0
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_5e24f94730f1c3815e6d19ee6ed5b0db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_5e24f94730f1c3815e6d19ee6ed5b0db.jpg not downloaded yet
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_ccf2ce80743a73381e7389c7a0467d75.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_ccf2ce80743a73381e7389c7a0467d75.jpg not downloaded yet
2026-03-30 09:10:19 [auto1.it] INFO: Found listing with ID: BJ56464
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ56464%27 HTTP/1.1" 200 None
2026-03-30 09:10:19 [auto1.it] INFO: Scrape type for BJ56464: 1
2026-03-30 09:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c7dd0>
2026-03-30 09:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_c7a29e1e201634655cd1339d67f94ddd.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_c7a29e1e201634655cd1339d67f94ddd.jpg saved to cache
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0152a889-6a7a-5468-9b1c-d1e66eede67f
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: ED24082
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED24082%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [auto1.it] INFO: Scrape type for ED24082: 2
2026-03-30 09:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05dbc653-9b65-58d7-9b7b-701df41c2445 with identifier: ED24082
2026-03-30 09:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05dbc653-9b65-58d7-9b7b-701df41c2445 with scrape type 2
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05dbc653-9b65-58d7-9b7b-701df41c2445 with scrape type 2
2026-03-30 09:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05dbc653-9b65-58d7-9b7b-701df41c2445, identifier: ED24082
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_262f4e36d8217eb3d3d3617986d4dc4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_262f4e36d8217eb3d3d3617986d4dc4a.jpg not downloaded yet
2026-03-30 09:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF67541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA03444/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60e05cb1-3fba-57de-b054-c36ed3c2db85 with identifier: LY78924
2026-03-30 09:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60e05cb1-3fba-57de-b054-c36ed3c2db85 with scrape type 1
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 60e05cb1-3fba-57de-b054-c36ed3c2db85
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F02%252F8d02fd50b4983d01190ee62bd2188a0c%252Fpa%252FLY78924_55b35840f944468325ee71b20e4ef92d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_55b35840f944468325ee71b20e4ef92d.jpg already downloaded
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F02%252F8d02fd50b4983d01190ee62bd2188a0c%252Fpa%252FLY78924_9421720505dff9f2e2a99a13ad404b2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_9421720505dff9f2e2a99a13ad404b2c.jpg already downloaded
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F02%252F8d02fd50b4983d01190ee62bd2188a0c%252Fpa%252FLY78924_90e45e45a941a3e709b490c6813ff839.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_90e45e45a941a3e709b490c6813ff839.jpg already downloaded
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F02%252F8d02fd50b4983d01190ee62bd2188a0c%252Fpa%252FLY78924_07867dfc40516ce537e9ec2ed561d93d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_07867dfc40516ce537e9ec2ed561d93d.jpg already downloaded
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F02%252F8d02fd50b4983d01190ee62bd2188a0c%252Fpa%252FLY78924_7dcee60b1e4fdccbe2e1589eed9d4769.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_7dcee60b1e4fdccbe2e1589eed9d4769.jpg already downloaded
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F02%252F8d02fd50b4983d01190ee62bd2188a0c%252Fpa%252FLY78924_44e355557f83f57a1529ac911979db48.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_44e355557f83f57a1529ac911979db48.jpg already downloaded
2026-03-30 09:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 60e05cb1-3fba-57de-b054-c36ed3c2db85, identifier: LY78924
2026-03-30 09:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24a5850>
2026-03-30 09:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_e074db75e63a03896c3b3531055e7ac8.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_e074db75e63a03896c3b3531055e7ac8.jpg saved to cache
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0152a889-6a7a-5468-9b1c-d1e66eede67f
2026-03-30 09:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_8f5b0fa76267c19e197d40a01179308b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_84c04a93893c9efa5403bc95c62b7f7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05dbc653-9b65-58d7-9b7b-701df41c2445 with identifier: ED24082
2026-03-30 09:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05dbc653-9b65-58d7-9b7b-701df41c2445 with identifier: ED24082
2026-03-30 09:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05dbc653-9b65-58d7-9b7b-701df41c2445 with identifier: ED24082 to the API
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:59:33Z',
 'fuel_type': 'diesel',
 'id': '05dbc653-9b65-58d7-9b7b-701df41c2445',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED24082',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 65337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-24',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2023}
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED24082%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [auto1.it] INFO: Saving data for ED24082: {'auction_closing_time': 1774972773.0, 'created_time': 1774343278.034568, 'last_price_update_time': 1774861820.800342}
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ED24082') HTTP/1.1" 204 0
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_3f85f42d383544f70529f7ce2b5c13bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_3f85f42d383544f70529f7ce2b5c13bd.jpg not downloaded yet
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_a23141c1ebf31c97406acf8c6a8cd2ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_a23141c1ebf31c97406acf8c6a8cd2ed.jpg not downloaded yet
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: YM87758
2026-03-30 09:10:20 [auto1.it] INFO: Found listing with ID: ZZ84284
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ84284%27 HTTP/1.1" 200 None
2026-03-30 09:10:20 [auto1.it] INFO: Scrape type for ZZ84284: 2
2026-03-30 09:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac11d82c-1a3d-5039-85d0-2411f9180f78 with identifier: ZZ84284
2026-03-30 09:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac11d82c-1a3d-5039-85d0-2411f9180f78 with scrape type 2
2026-03-30 09:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac11d82c-1a3d-5039-85d0-2411f9180f78 with scrape type 2
2026-03-30 09:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac11d82c-1a3d-5039-85d0-2411f9180f78, identifier: ZZ84284
2026-03-30 09:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 60e05cb1-3fba-57de-b054-c36ed3c2db85 with identifier: LY78924
2026-03-30 09:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 60e05cb1-3fba-57de-b054-c36ed3c2db85 with identifier: LY78924
2026-03-30 09:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 60e05cb1-3fba-57de-b054-c36ed3c2db85 with identifier: LY78924 to the API
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY78924>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:03:31Z',
 'fuel_type': 'petrol',
 'id': '60e05cb1-3fba-57de-b054-c36ed3c2db85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY78924',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 215985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_55b35840f944468325ee71b20e4ef92d.jpg',
                'https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_9421720505dff9f2e2a99a13ad404b2c.jpg',
                'https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_90e45e45a941a3e709b490c6813ff839.jpg',
                'https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_07867dfc40516ce537e9ec2ed561d93d.jpg',
                'https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_7dcee60b1e4fdccbe2e1589eed9d4769.jpg',
                'https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_44e355557f83f57a1529ac911979db48.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e05cb1-3fba-57de-b054-c36ed3c2db85/60e05cb1-3fba-57de-b054-c36ed3c2db85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_55b35840f944468325ee71b20e4ef92d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e05cb1-3fba-57de-b054-c36ed3c2db85/60e05cb1-3fba-57de-b054-c36ed3c2db85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_9421720505dff9f2e2a99a13ad404b2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e05cb1-3fba-57de-b054-c36ed3c2db85/60e05cb1-3fba-57de-b054-c36ed3c2db85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_90e45e45a941a3e709b490c6813ff839.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e05cb1-3fba-57de-b054-c36ed3c2db85/60e05cb1-3fba-57de-b054-c36ed3c2db85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_07867dfc40516ce537e9ec2ed561d93d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e05cb1-3fba-57de-b054-c36ed3c2db85/60e05cb1-3fba-57de-b054-c36ed3c2db85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_7dcee60b1e4fdccbe2e1589eed9d4769.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60e05cb1-3fba-57de-b054-c36ed3c2db85/60e05cb1-3fba-57de-b054-c36ed3c2db85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/02/8d02fd50b4983d01190ee62bd2188a0c/pa/LY78924_44e355557f83f57a1529ac911979db48.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2016}
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY78924%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Saving data for LY78924: {'created_time': 1774861821.344293, 'last_price_update_time': 1774861821.344303, 'auction_closing_time': 1774969411.0}
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY78924') HTTP/1.1" 204 0
2026-03-30 09:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_3d7fdcaa325ffbe7b6fe0efc25cbd023.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_c3aa9e193433e4d0d15239132121bf1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: CS63696
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: TK21590
2026-03-30 09:10:21 [auto1.it] INFO: Found listing with ID: BZ92290
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ92290%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Scrape type for BZ92290: 2
2026-03-30 09:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bb477bb-ec39-5b1f-9b04-18535a948078 with identifier: BZ92290
2026-03-30 09:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bb477bb-ec39-5b1f-9b04-18535a948078 with scrape type 2
2026-03-30 09:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bb477bb-ec39-5b1f-9b04-18535a948078 with scrape type 2
2026-03-30 09:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9bb477bb-ec39-5b1f-9b04-18535a948078, identifier: BZ92290
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_cc7cc9f929337227bd93e3103d25a821.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_cc7cc9f929337227bd93e3103d25a821.jpg not downloaded yet
2026-03-30 09:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac11d82c-1a3d-5039-85d0-2411f9180f78 with identifier: ZZ84284
2026-03-30 09:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac11d82c-1a3d-5039-85d0-2411f9180f78 with identifier: ZZ84284
2026-03-30 09:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ac11d82c-1a3d-5039-85d0-2411f9180f78 with identifier: ZZ84284 to the API
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:50:14Z',
 'fuel_type': 'diesel',
 'id': 'ac11d82c-1a3d-5039-85d0-2411f9180f78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ84284',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 162473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Advance 4Motion',
 'transmission': 'automatic',
 'trim': 'Advance 4Motion',
 'year': 2018}
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ84284%27 HTTP/1.1" 200 None
2026-03-30 09:10:21 [auto1.it] INFO: Saving data for ZZ84284: {'auction_closing_time': 1774972214.0, 'created_time': 1773404525.620285, 'last_price_update_time': 1774861821.913516}
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ84284') HTTP/1.1" 204 0
2026-03-30 09:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11b5c90>
2026-03-30 09:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_655020a324534d0be49f4122ec47576d.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_655020a324534d0be49f4122ec47576d.jpg saved to cache
2026-03-30 09:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85
2026-03-30 09:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2535910>
2026-03-30 09:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_61f9917f9702cfa42947053ae4de80e2.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_61f9917f9702cfa42947053ae4de80e2.jpg saved to cache
2026-03-30 09:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85
2026-03-30 09:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_221f3756b4b9fa3fb74727e95ac67af1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9bb477bb-ec39-5b1f-9b04-18535a948078 with identifier: BZ92290
2026-03-30 09:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9bb477bb-ec39-5b1f-9b04-18535a948078 with identifier: BZ92290
2026-03-30 09:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9bb477bb-ec39-5b1f-9b04-18535a948078 with identifier: BZ92290 to the API
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:13:06Z',
 'fuel_type': 'petrol',
 'id': '9bb477bb-ec39-5b1f-9b04-18535a948078',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ92290',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 104373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-30',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ92290%27 HTTP/1.1" 200 None
2026-03-30 09:10:22 [auto1.it] INFO: Saving data for BZ92290: {'auction_closing_time': 1774969986.0, 'created_time': 1774343164.965425, 'last_price_update_time': 1774861822.365601}
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BZ92290') HTTP/1.1" 204 0
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_eb54232586bc0eeacf8c29ef2449ca4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_eb54232586bc0eeacf8c29ef2449ca4d.jpg not downloaded yet
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_56390c950d356b35bcdce0bd4c2d5a77.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_56390c950d356b35bcdce0bd4c2d5a77.jpg not downloaded yet
2026-03-30 09:10:22 [auto1.it] INFO: Found listing with ID: DT80925
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT80925%27 HTTP/1.1" 200 None
2026-03-30 09:10:22 [auto1.it] INFO: Scrape type for DT80925: 2
2026-03-30 09:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff8859fe-3537-5caf-978d-12157f97325e with identifier: DT80925
2026-03-30 09:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff8859fe-3537-5caf-978d-12157f97325e with scrape type 2
2026-03-30 09:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff8859fe-3537-5caf-978d-12157f97325e with scrape type 2
2026-03-30 09:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff8859fe-3537-5caf-978d-12157f97325e, identifier: DT80925
2026-03-30 09:10:22 [auto1.it] INFO: Found listing with ID: CY38939
2026-03-30 09:10:22 [auto1.it] INFO: Found listing with ID: GB25673
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_c57420faeeed675fb8d786299e818e8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_c57420faeeed675fb8d786299e818e8f.jpg not downloaded yet
2026-03-30 09:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff8859fe-3537-5caf-978d-12157f97325e with identifier: DT80925
2026-03-30 09:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff8859fe-3537-5caf-978d-12157f97325e with identifier: DT80925
2026-03-30 09:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff8859fe-3537-5caf-978d-12157f97325e with identifier: DT80925 to the API
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:48:34Z',
 'fuel_type': 'diesel',
 'id': 'ff8859fe-3537-5caf-978d-12157f97325e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT80925',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 196720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-29',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet Trekking',
 'transmission': 'manual',
 'trim': 'Trekking',
 'year': 2016}
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT80925%27 HTTP/1.1" 200 None
2026-03-30 09:10:22 [auto1.it] INFO: Saving data for DT80925: {'auction_closing_time': 1774972114.0, 'created_time': 1774299970.970806, 'last_price_update_time': 1774861822.895815}
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DT80925') HTTP/1.1" 204 0
2026-03-30 09:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC84156> (referer: https://www.auto1.com/v1/car-details-view/EC84156/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP46989/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC14157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee45ffe10>
2026-03-30 09:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_8f5b0fa76267c19e197d40a01179308b.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_8f5b0fa76267c19e197d40a01179308b.jpg saved to cache
2026-03-30 09:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0152a889-6a7a-5468-9b1c-d1e66eede67f
2026-03-30 09:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee257da50>
2026-03-30 09:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_84c04a93893c9efa5403bc95c62b7f7d.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_84c04a93893c9efa5403bc95c62b7f7d.jpg saved to cache
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: JE22248
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: TK52144
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK52144%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for TK52144: 1
2026-03-30 09:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1324610>
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_3d7fdcaa325ffbe7b6fe0efc25cbd023.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_3d7fdcaa325ffbe7b6fe0efc25cbd023.jpg saved to cache
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0152a889-6a7a-5468-9b1c-d1e66eede67f
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1268cd0>
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_c3aa9e193433e4d0d15239132121bf1b.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_c3aa9e193433e4d0d15239132121bf1b.jpg saved to cache
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85
2026-03-30 09:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_ccf2ce80743a73381e7389c7a0467d75.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_d22728f5b9fbea1e0c9a66a29b71da3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_d22728f5b9fbea1e0c9a66a29b71da3f.jpg not downloaded yet
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24f2050>
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_221f3756b4b9fa3fb74727e95ac67af1.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_221f3756b4b9fa3fb74727e95ac67af1.jpg saved to cache
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9
2026-03-30 09:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_5e24f94730f1c3815e6d19ee6ed5b0db.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_262f4e36d8217eb3d3d3617986d4dc4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: WN04356
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: MV72435
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV72435%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for MV72435: 0
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: DN06430
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: DB48039
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB48039%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for DB48039: 2
2026-03-30 09:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33528671-2ebf-5053-b55d-390e7584dcbc with identifier: DB48039
2026-03-30 09:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33528671-2ebf-5053-b55d-390e7584dcbc with scrape type 2
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33528671-2ebf-5053-b55d-390e7584dcbc with scrape type 2
2026-03-30 09:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33528671-2ebf-5053-b55d-390e7584dcbc, identifier: DB48039
2026-03-30 09:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_a23141c1ebf31c97406acf8c6a8cd2ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_474923524c14e0ad1cc194b231cb7a37.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_474923524c14e0ad1cc194b231cb7a37.jpg not downloaded yet
2026-03-30 09:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33528671-2ebf-5053-b55d-390e7584dcbc with identifier: DB48039
2026-03-30 09:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33528671-2ebf-5053-b55d-390e7584dcbc with identifier: DB48039
2026-03-30 09:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33528671-2ebf-5053-b55d-390e7584dcbc with identifier: DB48039 to the API
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:59:37Z',
 'fuel_type': 'diesel',
 'id': '33528671-2ebf-5053-b55d-390e7584dcbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB48039',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 55157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-07',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi EcoBlue Titanium 4x4',
 'transmission': 'automatic',
 'trim': 'Titanium 4x4',
 'year': 2020}
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB48039%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Saving data for DB48039: {'auction_closing_time': 1774886377.0, 'created_time': 1774516025.413551, 'last_price_update_time': 1774861823.630826}
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DB48039') HTTP/1.1" 204 0
2026-03-30 09:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed444c9e-7973-5740-a2a6-4deb5a19e8da with identifier: EC84156
2026-03-30 09:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed444c9e-7973-5740-a2a6-4deb5a19e8da with scrape type 1
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed444c9e-7973-5740-a2a6-4deb5a19e8da
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_091c5d83290c0867ef92927e9057874b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_091c5d83290c0867ef92927e9057874b.jpg not downloaded yet
2026-03-30 09:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_56390c950d356b35bcdce0bd4c2d5a77.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_cc7cc9f929337227bd93e3103d25a821.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: PG30215
2026-03-30 09:10:23 [auto1.it] INFO: Found listing with ID: HJ29626
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ29626%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [auto1.it] INFO: Scrape type for HJ29626: 2
2026-03-30 09:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d68be10-2f5e-597b-8605-04cb82f7d37d with identifier: HJ29626
2026-03-30 09:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d68be10-2f5e-597b-8605-04cb82f7d37d with scrape type 2
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d68be10-2f5e-597b-8605-04cb82f7d37d with scrape type 2
2026-03-30 09:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d68be10-2f5e-597b-8605-04cb82f7d37d, identifier: HJ29626
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_aa4976e3f5cc7fbdac4960d304e24d5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_aa4976e3f5cc7fbdac4960d304e24d5e.jpg not downloaded yet
2026-03-30 09:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d68be10-2f5e-597b-8605-04cb82f7d37d with identifier: HJ29626
2026-03-30 09:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d68be10-2f5e-597b-8605-04cb82f7d37d with identifier: HJ29626
2026-03-30 09:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d68be10-2f5e-597b-8605-04cb82f7d37d with identifier: HJ29626 to the API
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:38:44Z',
 'fuel_type': 'diesel',
 'id': '9d68be10-2f5e-597b-8605-04cb82f7d37d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ29626',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 284275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-31',
 'seller_name': None,
 'title': 'Fiat Bravo 1.6 JTDM Multijet Dynamic',
 'transmission': 'manual',
 'trim': 'Multijet Dynamic',
 'year': 2010}
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ29626%27 HTTP/1.1" 200 None
2026-03-30 09:10:24 [auto1.it] INFO: Saving data for HJ29626: {'auction_closing_time': 1774885124.0, 'created_time': 1772750852.858451, 'last_price_update_time': 1774861824.233223}
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HJ29626') HTTP/1.1" 204 0
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_3832fbbfb80daaf8b30b3376f7faaa01.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_3832fbbfb80daaf8b30b3376f7faaa01.jpg not downloaded yet
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1138e90>
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_ccf2ce80743a73381e7389c7a0467d75.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_ccf2ce80743a73381e7389c7a0467d75.jpg saved to cache
2026-03-30 09:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0152a889-6a7a-5468-9b1c-d1e66eede67f
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2879750>
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_5e24f94730f1c3815e6d19ee6ed5b0db.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_5e24f94730f1c3815e6d19ee6ed5b0db.jpg saved to cache
2026-03-30 09:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2637b50>
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_262f4e36d8217eb3d3d3617986d4dc4a.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_262f4e36d8217eb3d3d3617986d4dc4a.jpg saved to cache
2026-03-30 09:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9
2026-03-30 09:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_eb54232586bc0eeacf8c29ef2449ca4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:24 [auto1.it] INFO: Found listing with ID: LE34139
2026-03-30 09:10:24 [auto1.it] INFO: Found listing with ID: WA17168
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA17168%27 HTTP/1.1" 200 None
2026-03-30 09:10:24 [auto1.it] INFO: Scrape type for WA17168: 2
2026-03-30 09:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e40a3292-d11d-5f15-8159-63da3b5e01d8 with identifier: WA17168
2026-03-30 09:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e40a3292-d11d-5f15-8159-63da3b5e01d8 with scrape type 2
2026-03-30 09:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e40a3292-d11d-5f15-8159-63da3b5e01d8 with scrape type 2
2026-03-30 09:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e40a3292-d11d-5f15-8159-63da3b5e01d8, identifier: WA17168
2026-03-30 09:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_d22728f5b9fbea1e0c9a66a29b71da3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_a1cd309371b875dfdb960f58f19d5b1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_a1cd309371b875dfdb960f58f19d5b1a.jpg not downloaded yet
2026-03-30 09:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e40a3292-d11d-5f15-8159-63da3b5e01d8 with identifier: WA17168
2026-03-30 09:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e40a3292-d11d-5f15-8159-63da3b5e01d8 with identifier: WA17168
2026-03-30 09:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e40a3292-d11d-5f15-8159-63da3b5e01d8 with identifier: WA17168 to the API
2026-03-30 09:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:07:38Z',
 'fuel_type': 'diesel',
 'id': 'e40a3292-d11d-5f15-8159-63da3b5e01d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA17168',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 121674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-19',
 'seller_name': None,
 'title': 'BMW X4 xDrive 30d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA17168%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Saving data for WA17168: {'auction_closing_time': 1774883258.0, 'created_time': 1774775123.080025, 'last_price_update_time': 1774861825.252402}
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA17168') HTTP/1.1" 204 0
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_91650698165cb98a08bdfae7e15c2db6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_91650698165cb98a08bdfae7e15c2db6.jpg not downloaded yet
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2775e10>
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_a23141c1ebf31c97406acf8c6a8cd2ed.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_a23141c1ebf31c97406acf8c6a8cd2ed.jpg saved to cache
2026-03-30 09:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0152a889-6a7a-5468-9b1c-d1e66eede67f
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2671ad0>
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_56390c950d356b35bcdce0bd4c2d5a77.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_56390c950d356b35bcdce0bd4c2d5a77.jpg saved to cache
2026-03-30 09:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0152a889-6a7a-5468-9b1c-d1e66eede67f
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2576fd0>
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_cc7cc9f929337227bd93e3103d25a821.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_cc7cc9f929337227bd93e3103d25a821.jpg saved to cache
2026-03-30 09:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: NW33214
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: HM75417
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM75417%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for HM75417: 2
2026-03-30 09:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9e25006-47e2-5c2f-bee5-4ee804e81b21 with identifier: HM75417
2026-03-30 09:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9e25006-47e2-5c2f-bee5-4ee804e81b21 with scrape type 2
2026-03-30 09:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9e25006-47e2-5c2f-bee5-4ee804e81b21 with scrape type 2
2026-03-30 09:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f9e25006-47e2-5c2f-bee5-4ee804e81b21, identifier: HM75417
2026-03-30 09:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_c57420faeeed675fb8d786299e818e8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f9e25006-47e2-5c2f-bee5-4ee804e81b21 with identifier: HM75417
2026-03-30 09:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f9e25006-47e2-5c2f-bee5-4ee804e81b21 with identifier: HM75417
2026-03-30 09:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f9e25006-47e2-5c2f-bee5-4ee804e81b21 with identifier: HM75417 to the API
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 111,
 'expiration_date': '2026-03-30T15:26:12Z',
 'fuel_type': 'petrol',
 'id': 'f9e25006-47e2-5c2f-bee5-4ee804e81b21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM75417',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 126678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-17',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Serie Speciale',
 'transmission': 'manual',
 'trim': 'Serie Speciale',
 'year': 2008}
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM75417%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Saving data for HM75417: {'auction_closing_time': 1774884372.0, 'created_time': 1774559486.954576, 'last_price_update_time': 1774861825.821413}
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HM75417') HTTP/1.1" 204 0
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_bda8483e4867f059ce1ccc17d3214e35.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_bda8483e4867f059ce1ccc17d3214e35.jpg not downloaded yet
2026-03-30 09:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT29802/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_3f85f42d383544f70529f7ce2b5c13bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: KM60643
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: YJ19643
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: FA14531
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: UK81128
2026-03-30 09:10:25 [auto1.it] INFO: Found listing with ID: EX63117
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX63117%27 HTTP/1.1" 200 None
2026-03-30 09:10:25 [auto1.it] INFO: Scrape type for EX63117: 2
2026-03-30 09:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b88cc9-dee7-5c44-8de8-c97f061f8d74 with identifier: EX63117
2026-03-30 09:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b88cc9-dee7-5c44-8de8-c97f061f8d74 with scrape type 2
2026-03-30 09:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2b88cc9-dee7-5c44-8de8-c97f061f8d74 with scrape type 2
2026-03-30 09:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f2b88cc9-dee7-5c44-8de8-c97f061f8d74, identifier: EX63117
2026-03-30 09:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP36077> (referer: https://www.auto1.com/v1/car-details-view/PP36077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY28860> (referer: https://www.auto1.com/v1/car-details-view/AY28860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ29974> (referer: https://www.auto1.com/v1/car-details-view/DJ29974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2672210>
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_eb54232586bc0eeacf8c29ef2449ca4d.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_eb54232586bc0eeacf8c29ef2449ca4d.jpg saved to cache
2026-03-30 09:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee271ff90>
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_d22728f5b9fbea1e0c9a66a29b71da3f.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_d22728f5b9fbea1e0c9a66a29b71da3f.jpg saved to cache
2026-03-30 09:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9
2026-03-30 09:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f2b88cc9-dee7-5c44-8de8-c97f061f8d74 with identifier: EX63117
2026-03-30 09:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f2b88cc9-dee7-5c44-8de8-c97f061f8d74 with identifier: EX63117
2026-03-30 09:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f2b88cc9-dee7-5c44-8de8-c97f061f8d74 with identifier: EX63117 to the API
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:20Z',
 'fuel_type': 'petrol',
 'id': 'f2b88cc9-dee7-5c44-8de8-c97f061f8d74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX63117',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 95411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-04',
 'seller_name': None,
 'title': 'Subaru XV 2.0 Mild-Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2020}
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX63117%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Saving data for EX63117: {'auction_closing_time': 1774883780.0, 'created_time': 1774775123.401744, 'last_price_update_time': 1774861826.365083}
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EX63117') HTTP/1.1" 204 0
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_b4ec5ec28771693bd67003e4d3e2d6c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_b4ec5ec28771693bd67003e4d3e2d6c6.jpg not downloaded yet
2026-03-30 09:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_aa4976e3f5cc7fbdac4960d304e24d5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_3832fbbfb80daaf8b30b3376f7faaa01.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: NP73440
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: XY01998
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: PU31383
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: VW55609
2026-03-30 09:10:26 [auto1.it] INFO: Found listing with ID: GT29075
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT29075%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Scrape type for GT29075: 2
2026-03-30 09:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c611faae-d2a5-5e54-b5f0-42430e76dddc with identifier: GT29075
2026-03-30 09:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c611faae-d2a5-5e54-b5f0-42430e76dddc with scrape type 2
2026-03-30 09:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c611faae-d2a5-5e54-b5f0-42430e76dddc with scrape type 2
2026-03-30 09:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c611faae-d2a5-5e54-b5f0-42430e76dddc, identifier: GT29075
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee268b810>
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_c57420faeeed675fb8d786299e818e8f.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_c57420faeeed675fb8d786299e818e8f.jpg saved to cache
2026-03-30 09:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9
2026-03-30 09:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c611faae-d2a5-5e54-b5f0-42430e76dddc with identifier: GT29075
2026-03-30 09:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c611faae-d2a5-5e54-b5f0-42430e76dddc with identifier: GT29075
2026-03-30 09:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c611faae-d2a5-5e54-b5f0-42430e76dddc with identifier: GT29075 to the API
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:49:07Z',
 'fuel_type': 'gas',
 'id': 'c611faae-d2a5-5e54-b5f0-42430e76dddc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT29075',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 327566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-02',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 EcoFuel Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT29075%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [auto1.it] INFO: Saving data for GT29075: {'auction_closing_time': 1774885747.0, 'created_time': 1774559494.210895, 'last_price_update_time': 1774861826.936875}
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GT29075') HTTP/1.1" 204 0
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_ee078871b27dd50efebef9adb4614f92.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_ee078871b27dd50efebef9adb4614f92.jpg not downloaded yet
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1205150>
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_3f85f42d383544f70529f7ce2b5c13bd.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_3f85f42d383544f70529f7ce2b5c13bd.jpg saved to cache
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85
2026-03-30 09:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a61bcd7-3cf4-5369-b8b9-eef30b807582 with identifier: PP36077
2026-03-30 09:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582 with scrape type 1
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_fce0fbb76d693bed2c20a245d2e5e619.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_fce0fbb76d693bed2c20a245d2e5e619.jpg not downloaded yet
2026-03-30 09:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc24aaaa-1bfd-564d-8345-3dd1619b2181 with identifier: AY28860
2026-03-30 09:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc24aaaa-1bfd-564d-8345-3dd1619b2181 with scrape type 1
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fc24aaaa-1bfd-564d-8345-3dd1619b2181
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Ff2%252Fcff215083afe3839c9a42a5112f959d5%252Fpa%252FAY28860_513be43759502d6d32bb4932a8289e80.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_513be43759502d6d32bb4932a8289e80.jpg not downloaded yet
2026-03-30 09:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bab12fba-4299-517d-bba1-f5b3ed30c643 with identifier: DJ29974
2026-03-30 09:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bab12fba-4299-517d-bba1-f5b3ed30c643 with scrape type 1
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bab12fba-4299-517d-bba1-f5b3ed30c643
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_a782150cf636bddcd25a0d8086384cd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_a782150cf636bddcd25a0d8086384cd4.jpg not downloaded yet
2026-03-30 09:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_a1cd309371b875dfdb960f58f19d5b1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:27 [auto1.it] INFO: Found listing with ID: HB16965
2026-03-30 09:10:27 [auto1.it] INFO: Found listing with ID: GU77737
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU77737%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [auto1.it] INFO: Scrape type for GU77737: 2
2026-03-30 09:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eaa813d-84fd-5334-973c-6e23ac9f9c2d with identifier: GU77737
2026-03-30 09:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eaa813d-84fd-5334-973c-6e23ac9f9c2d with scrape type 2
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eaa813d-84fd-5334-973c-6e23ac9f9c2d with scrape type 2
2026-03-30 09:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8eaa813d-84fd-5334-973c-6e23ac9f9c2d, identifier: GU77737
2026-03-30 09:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK93114> (referer: https://www.auto1.com/v1/car-details-view/PK93114/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC79116> (referer: https://www.auto1.com/v1/car-details-view/WC79116/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_bda8483e4867f059ce1ccc17d3214e35.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_91650698165cb98a08bdfae7e15c2db6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8eaa813d-84fd-5334-973c-6e23ac9f9c2d with identifier: GU77737
2026-03-30 09:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8eaa813d-84fd-5334-973c-6e23ac9f9c2d with identifier: GU77737
2026-03-30 09:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8eaa813d-84fd-5334-973c-6e23ac9f9c2d with identifier: GU77737 to the API
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:35:19Z',
 'fuel_type': 'diesel',
 'id': '8eaa813d-84fd-5334-973c-6e23ac9f9c2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU77737',
 'listing': 'auction',
 'make': 'MG Rover',
 'model': '75',
 'odometer': 291073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-31',
 'seller_name': None,
 'title': 'MG Rover 75 2.0 CDTI CDTi Classic',
 'transmission': 'manual',
 'trim': 'CDTi Classic',
 'year': 2004}
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU77737%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [auto1.it] INFO: Saving data for GU77737: {'auction_closing_time': 1774884919.0, 'created_time': 1774559513.491823, 'last_price_update_time': 1774861827.496733}
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GU77737') HTTP/1.1" 204 0
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_b36bae9479af826ebd6cba7a3197b615.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_b36bae9479af826ebd6cba7a3197b615.jpg not downloaded yet
2026-03-30 09:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_bce9899feb13d780cee4e4f27979ba7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_bce9899feb13d780cee4e4f27979ba7e.jpg not downloaded yet
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Ff2%252Fcff215083afe3839c9a42a5112f959d5%252Fpa%252FAY28860_1d602c12912bb02e51806a6c2b33761e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_1d602c12912bb02e51806a6c2b33761e.jpg not downloaded yet
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_65e0c8b05bd819de39524d93a9fc56aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_65e0c8b05bd819de39524d93a9fc56aa.jpg not downloaded yet
2026-03-30 09:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13d7250>
2026-03-30 09:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_aa4976e3f5cc7fbdac4960d304e24d5e.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_aa4976e3f5cc7fbdac4960d304e24d5e.jpg saved to cache
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9
2026-03-30 09:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2602650>
2026-03-30 09:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_3832fbbfb80daaf8b30b3376f7faaa01.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_3832fbbfb80daaf8b30b3376f7faaa01.jpg saved to cache
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed444c9e-7973-5740-a2a6-4deb5a19e8da
2026-03-30 09:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_091c5d83290c0867ef92927e9057874b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:27 [auto1.it] INFO: Found listing with ID: MR77890
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR77890%27 HTTP/1.1" 200 None
2026-03-30 09:10:27 [auto1.it] INFO: Scrape type for MR77890: 2
2026-03-30 09:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06569f6e-6843-5c09-9181-3c2d7518213f with identifier: MR77890
2026-03-30 09:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06569f6e-6843-5c09-9181-3c2d7518213f with scrape type 2
2026-03-30 09:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06569f6e-6843-5c09-9181-3c2d7518213f with scrape type 2
2026-03-30 09:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 06569f6e-6843-5c09-9181-3c2d7518213f, identifier: MR77890
2026-03-30 09:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_474923524c14e0ad1cc194b231cb7a37.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_ef2d8286c0bbbb2fb2a9a6838ac08247.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 06569f6e-6843-5c09-9181-3c2d7518213f with identifier: MR77890
2026-03-30 09:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 06569f6e-6843-5c09-9181-3c2d7518213f with identifier: MR77890
2026-03-30 09:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 06569f6e-6843-5c09-9181-3c2d7518213f with identifier: MR77890 to the API
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:40:52Z',
 'fuel_type': 'petrol',
 'id': '06569f6e-6843-5c09-9181-3c2d7518213f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR77890',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 86982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seller_name': None,
 'title': 'Kia XCeed 1.5 TGDI Mild-Hybrid Business Class',
 'transmission': 'automatic',
 'trim': 'Business Class',
 'year': 2022}
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR77890%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [auto1.it] INFO: Saving data for MR77890: {'auction_closing_time': 1774885252.0, 'created_time': 1774775124.786673, 'last_price_update_time': 1774861828.119764}
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR77890') HTTP/1.1" 204 0
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_0eeea86a11d97370db69c2ec97df413c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_0eeea86a11d97370db69c2ec97df413c.jpg not downloaded yet
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_8944f5acf8cd83c7a109a5ae22111da5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_8944f5acf8cd83c7a109a5ae22111da5.jpg not downloaded yet
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Ff2%252Fcff215083afe3839c9a42a5112f959d5%252Fpa%252FAY28860_b27ec8ff804dd171e698b14811648c7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_b27ec8ff804dd171e698b14811648c7b.jpg not downloaded yet
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_775c4a6995863d082be5d4702a4ba347.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_775c4a6995863d082be5d4702a4ba347.jpg not downloaded yet
2026-03-30 09:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2549b90>
2026-03-30 09:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_a1cd309371b875dfdb960f58f19d5b1a.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_a1cd309371b875dfdb960f58f19d5b1a.jpg saved to cache
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9
2026-03-30 09:10:28 [auto1.it] INFO: Found listing with ID: YV05743
2026-03-30 09:10:28 [auto1.it] INFO: Found listing with ID: PF34434
2026-03-30 09:10:28 [auto1.it] INFO: Found listing with ID: WC74031
2026-03-30 09:10:28 [auto1.it] INFO: Channel: 24h | Page: 22 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3740b27d-076f-58ad-80ff-61070459cdfc with identifier: PK93114
2026-03-30 09:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3740b27d-076f-58ad-80ff-61070459cdfc with scrape type 1
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3740b27d-076f-58ad-80ff-61070459cdfc
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F18%252Fe1182721d28a7544150afbe76b475ec8%252Fpa%252FPK93114_102df52c7eace9f36e47f12fd91efec9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_102df52c7eace9f36e47f12fd91efec9.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F18%252Fe1182721d28a7544150afbe76b475ec8%252Fpa%252FPK93114_a4dba0b968b5ed143c908428ede8adfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_a4dba0b968b5ed143c908428ede8adfc.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F18%252Fe1182721d28a7544150afbe76b475ec8%252Fpa%252FPK93114_d7f5e22aefddc1e3a34d9dced6bfe924.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_d7f5e22aefddc1e3a34d9dced6bfe924.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F18%252Fe1182721d28a7544150afbe76b475ec8%252Fpa%252FPK93114_5cf0d7fded19e72292952cebfbaafc4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_5cf0d7fded19e72292952cebfbaafc4a.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F18%252Fe1182721d28a7544150afbe76b475ec8%252Fpa%252FPK93114_b2c9884d7475d47c52cc43d924498c3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_b2c9884d7475d47c52cc43d924498c3b.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F18%252Fe1182721d28a7544150afbe76b475ec8%252Fpa%252FPK93114_738726c8d5842625c70fc4467bc1a3d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_738726c8d5842625c70fc4467bc1a3d6.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F18%252Fe1182721d28a7544150afbe76b475ec8%252Fpa%252FPK93114_483aa66a8a120b3c002c0072d163478b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_483aa66a8a120b3c002c0072d163478b.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F18%252Fe1182721d28a7544150afbe76b475ec8%252Fpa%252FPK93114_2f36d49aac59cc55ce2bb2a8488d2fbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_2f36d49aac59cc55ce2bb2a8488d2fbd.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F18%252Fe1182721d28a7544150afbe76b475ec8%252Fpa%252FPK93114_1024a28c48c669e4cc77bc3d2963d10f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_1024a28c48c669e4cc77bc3d2963d10f.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F18%252Fe1182721d28a7544150afbe76b475ec8%252Fpa%252FPK93114_c481d45fd32e5d268a047be700e3d659.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_c481d45fd32e5d268a047be700e3d659.jpg already downloaded
2026-03-30 09:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3740b27d-076f-58ad-80ff-61070459cdfc, identifier: PK93114
2026-03-30 09:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00c17cf7-e54a-5421-b2a8-f72afe7f3922 with identifier: WC79116
2026-03-30 09:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00c17cf7-e54a-5421-b2a8-f72afe7f3922 with scrape type 1
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00c17cf7-e54a-5421-b2a8-f72afe7f3922
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F90%252F0c90f23654bbde25c823426f3ab96b84%252Fpa%252FWC79116_e1abd50a32be64c083ed563a7950be7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_e1abd50a32be64c083ed563a7950be7f.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F90%252F0c90f23654bbde25c823426f3ab96b84%252Fpa%252FWC79116_10739bce1614e43026df17b113515a4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_10739bce1614e43026df17b113515a4d.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F90%252F0c90f23654bbde25c823426f3ab96b84%252Fpa%252FWC79116_fbeedb96851ede434044c36cc1d25393.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_fbeedb96851ede434044c36cc1d25393.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F90%252F0c90f23654bbde25c823426f3ab96b84%252Fpa%252FWC79116_e0a649844ba5b4d252c6b4e3c904182e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_e0a649844ba5b4d252c6b4e3c904182e.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F90%252F0c90f23654bbde25c823426f3ab96b84%252Fpa%252FWC79116_a3847d3f41f589688f21dc2a6f2dd4c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_a3847d3f41f589688f21dc2a6f2dd4c3.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F90%252F0c90f23654bbde25c823426f3ab96b84%252Fpa%252FWC79116_374c357568bc261cd8cfacd3eb8985cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_374c357568bc261cd8cfacd3eb8985cd.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F90%252F0c90f23654bbde25c823426f3ab96b84%252Fpa%252FWC79116_def15c4c844ba85cc40e01f99a8c52fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_def15c4c844ba85cc40e01f99a8c52fe.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F90%252F0c90f23654bbde25c823426f3ab96b84%252Fpa%252FWC79116_a015d61697723f29e075392d2e7b1e79.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_a015d61697723f29e075392d2e7b1e79.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F90%252F0c90f23654bbde25c823426f3ab96b84%252Fpa%252FWC79116_5a4cd2d39165410b1763094cc53e4d32.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_5a4cd2d39165410b1763094cc53e4d32.jpg already downloaded
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F90%252F0c90f23654bbde25c823426f3ab96b84%252Fpa%252FWC79116_f646e5d7cc7a6cd989b2d998eab33339.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_f646e5d7cc7a6cd989b2d998eab33339.jpg already downloaded
2026-03-30 09:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 00c17cf7-e54a-5421-b2a8-f72afe7f3922, identifier: WC79116
2026-03-30 09:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48d0d10>
2026-03-30 09:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_bda8483e4867f059ce1ccc17d3214e35.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_bda8483e4867f059ce1ccc17d3214e35.jpg saved to cache
2026-03-30 09:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed444c9e-7973-5740-a2a6-4deb5a19e8da
2026-03-30 09:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11a5250>
2026-03-30 09:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_91650698165cb98a08bdfae7e15c2db6.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_91650698165cb98a08bdfae7e15c2db6.jpg saved to cache
2026-03-30 09:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed444c9e-7973-5740-a2a6-4deb5a19e8da
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_18055458c0783a97dbe05aace73cd052.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_18055458c0783a97dbe05aace73cd052.jpg not downloaded yet
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_e517c9140c13bc5442ec4c3cb4f128b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_e517c9140c13bc5442ec4c3cb4f128b5.jpg not downloaded yet
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Ff2%252Fcff215083afe3839c9a42a5112f959d5%252Fpa%252FAY28860_3fa686bd0c2b1621da848d127600f1f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_3fa686bd0c2b1621da848d127600f1f9.jpg not downloaded yet
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_06c97269ea43fd5ad93def6e50184e19.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_06c97269ea43fd5ad93def6e50184e19.jpg not downloaded yet
2026-03-30 09:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3740b27d-076f-58ad-80ff-61070459cdfc with identifier: PK93114
2026-03-30 09:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3740b27d-076f-58ad-80ff-61070459cdfc with identifier: PK93114
2026-03-30 09:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3740b27d-076f-58ad-80ff-61070459cdfc with identifier: PK93114 to the API
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PK93114>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:32:18Z',
 'fuel_type': 'diesel',
 'id': '3740b27d-076f-58ad-80ff-61070459cdfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK93114',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 201019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_102df52c7eace9f36e47f12fd91efec9.jpg',
                'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_a4dba0b968b5ed143c908428ede8adfc.jpg',
                'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_d7f5e22aefddc1e3a34d9dced6bfe924.jpg',
                'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_5cf0d7fded19e72292952cebfbaafc4a.jpg',
                'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_b2c9884d7475d47c52cc43d924498c3b.jpg',
                'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_738726c8d5842625c70fc4467bc1a3d6.jpg',
                'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_483aa66a8a120b3c002c0072d163478b.jpg',
                'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_2f36d49aac59cc55ce2bb2a8488d2fbd.jpg',
                'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_1024a28c48c669e4cc77bc3d2963d10f.jpg',
                'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_c481d45fd32e5d268a047be700e3d659.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3740b27d-076f-58ad-80ff-61070459cdfc/3740b27d-076f-58ad-80ff-61070459cdfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_102df52c7eace9f36e47f12fd91efec9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3740b27d-076f-58ad-80ff-61070459cdfc/3740b27d-076f-58ad-80ff-61070459cdfc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_a4dba0b968b5ed143c908428ede8adfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3740b27d-076f-58ad-80ff-61070459cdfc/3740b27d-076f-58ad-80ff-61070459cdfc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_d7f5e22aefddc1e3a34d9dced6bfe924.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3740b27d-076f-58ad-80ff-61070459cdfc/3740b27d-076f-58ad-80ff-61070459cdfc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_5cf0d7fded19e72292952cebfbaafc4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3740b27d-076f-58ad-80ff-61070459cdfc/3740b27d-076f-58ad-80ff-61070459cdfc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_b2c9884d7475d47c52cc43d924498c3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3740b27d-076f-58ad-80ff-61070459cdfc/3740b27d-076f-58ad-80ff-61070459cdfc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_738726c8d5842625c70fc4467bc1a3d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3740b27d-076f-58ad-80ff-61070459cdfc/3740b27d-076f-58ad-80ff-61070459cdfc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491290,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_483aa66a8a120b3c002c0072d163478b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3740b27d-076f-58ad-80ff-61070459cdfc/3740b27d-076f-58ad-80ff-61070459cdfc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_2f36d49aac59cc55ce2bb2a8488d2fbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3740b27d-076f-58ad-80ff-61070459cdfc/3740b27d-076f-58ad-80ff-61070459cdfc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_1024a28c48c669e4cc77bc3d2963d10f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3740b27d-076f-58ad-80ff-61070459cdfc/3740b27d-076f-58ad-80ff-61070459cdfc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/18/e1182721d28a7544150afbe76b475ec8/pa/PK93114_c481d45fd32e5d268a047be700e3d659.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2018}
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK93114%27 HTTP/1.1" 200 None
2026-03-30 09:10:29 [auto1.it] INFO: Saving data for PK93114: {'created_time': 1774861829.532037, 'last_price_update_time': 1774861829.53205, 'auction_closing_time': 1774971138.0}
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PK93114') HTTP/1.1" 204 0
2026-03-30 09:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 00c17cf7-e54a-5421-b2a8-f72afe7f3922 with identifier: WC79116
2026-03-30 09:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 00c17cf7-e54a-5421-b2a8-f72afe7f3922 with identifier: WC79116
2026-03-30 09:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 00c17cf7-e54a-5421-b2a8-f72afe7f3922 with identifier: WC79116 to the API
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WC79116>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:12:47Z',
 'fuel_type': 'diesel',
 'id': '00c17cf7-e54a-5421-b2a8-f72afe7f3922',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC79116',
 'listing': 'auction',
 'location': 'IT, Brescia',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 213694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_e1abd50a32be64c083ed563a7950be7f.jpg',
                'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_10739bce1614e43026df17b113515a4d.jpg',
                'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_fbeedb96851ede434044c36cc1d25393.jpg',
                'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_e0a649844ba5b4d252c6b4e3c904182e.jpg',
                'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_a3847d3f41f589688f21dc2a6f2dd4c3.jpg',
                'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_374c357568bc261cd8cfacd3eb8985cd.jpg',
                'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_def15c4c844ba85cc40e01f99a8c52fe.jpg',
                'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_a015d61697723f29e075392d2e7b1e79.jpg',
                'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_5a4cd2d39165410b1763094cc53e4d32.jpg',
                'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_f646e5d7cc7a6cd989b2d998eab33339.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00c17cf7-e54a-5421-b2a8-f72afe7f3922/00c17cf7-e54a-5421-b2a8-f72afe7f3922_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2505230,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_e1abd50a32be64c083ed563a7950be7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00c17cf7-e54a-5421-b2a8-f72afe7f3922/00c17cf7-e54a-5421-b2a8-f72afe7f3922_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604945,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_10739bce1614e43026df17b113515a4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00c17cf7-e54a-5421-b2a8-f72afe7f3922/00c17cf7-e54a-5421-b2a8-f72afe7f3922_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_fbeedb96851ede434044c36cc1d25393.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00c17cf7-e54a-5421-b2a8-f72afe7f3922/00c17cf7-e54a-5421-b2a8-f72afe7f3922_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693742,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_e0a649844ba5b4d252c6b4e3c904182e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00c17cf7-e54a-5421-b2a8-f72afe7f3922/00c17cf7-e54a-5421-b2a8-f72afe7f3922_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_a3847d3f41f589688f21dc2a6f2dd4c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00c17cf7-e54a-5421-b2a8-f72afe7f3922/00c17cf7-e54a-5421-b2a8-f72afe7f3922_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_374c357568bc261cd8cfacd3eb8985cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00c17cf7-e54a-5421-b2a8-f72afe7f3922/00c17cf7-e54a-5421-b2a8-f72afe7f3922_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_def15c4c844ba85cc40e01f99a8c52fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00c17cf7-e54a-5421-b2a8-f72afe7f3922/00c17cf7-e54a-5421-b2a8-f72afe7f3922_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_a015d61697723f29e075392d2e7b1e79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00c17cf7-e54a-5421-b2a8-f72afe7f3922/00c17cf7-e54a-5421-b2a8-f72afe7f3922_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_5a4cd2d39165410b1763094cc53e4d32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00c17cf7-e54a-5421-b2a8-f72afe7f3922/00c17cf7-e54a-5421-b2a8-f72afe7f3922_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/90/0c90f23654bbde25c823426f3ab96b84/pa/WC79116_f646e5d7cc7a6cd989b2d998eab33339.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC79116%27 HTTP/1.1" 200 None
2026-03-30 09:10:30 [auto1.it] INFO: Saving data for WC79116: {'created_time': 1774861830.030949, 'last_price_update_time': 1774861830.030958, 'auction_closing_time': 1774969967.0}
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WC79116') HTTP/1.1" 204 0
2026-03-30 09:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_b8596ba1d3fdafa6bf473d147c79703a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_b4ec5ec28771693bd67003e4d3e2d6c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_a782150cf636bddcd25a0d8086384cd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_513be43759502d6d32bb4932a8289e80.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_ee078871b27dd50efebef9adb4614f92.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:30 [auto1.it] INFO: Found listing with ID: JX88072
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX88072%27 HTTP/1.1" 200 None
2026-03-30 09:10:30 [auto1.it] INFO: Scrape type for JX88072: 2
2026-03-30 09:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92493593-da34-586f-ad1d-814e875fe119 with identifier: JX88072
2026-03-30 09:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92493593-da34-586f-ad1d-814e875fe119 with scrape type 2
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92493593-da34-586f-ad1d-814e875fe119 with scrape type 2
2026-03-30 09:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 92493593-da34-586f-ad1d-814e875fe119, identifier: JX88072
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee267aa50>
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_091c5d83290c0867ef92927e9057874b.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_091c5d83290c0867ef92927e9057874b.jpg saved to cache
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed444c9e-7973-5740-a2a6-4deb5a19e8da
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2677050>
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_474923524c14e0ad1cc194b231cb7a37.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_474923524c14e0ad1cc194b231cb7a37.jpg saved to cache
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c6910>
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F27%252F032731624601f5029d4648d7debb516e%252Fpa%252FTJ75613_ef2d8286c0bbbb2fb2a9a6838ac08247.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_ef2d8286c0bbbb2fb2a9a6838ac08247.jpg saved to cache
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9
2026-03-30 09:10:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9, skipping ID generation
2026-03-30 09:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9 with scrape type 1
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9 sending to next pipeline
2026-03-30 09:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9, identifier: TJ75613
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_0e2810e4db77771eb784731d1fee8b8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_0e2810e4db77771eb784731d1fee8b8f.jpg not downloaded yet
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_38b0595dcacc039b82b52547f19f60c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_38b0595dcacc039b82b52547f19f60c6.jpg not downloaded yet
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Ff2%252Fcff215083afe3839c9a42a5112f959d5%252Fpa%252FAY28860_d90abb7233be49ff9e3084e14480077d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_d90abb7233be49ff9e3084e14480077d.jpg not downloaded yet
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_6fbcfaacc3bcd3185d2add5d1dcdde8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_6fbcfaacc3bcd3185d2add5d1dcdde8d.jpg not downloaded yet
2026-03-30 09:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 92493593-da34-586f-ad1d-814e875fe119 with identifier: JX88072
2026-03-30 09:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 92493593-da34-586f-ad1d-814e875fe119 with identifier: JX88072
2026-03-30 09:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 92493593-da34-586f-ad1d-814e875fe119 with identifier: JX88072 to the API
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:32:34Z',
 'fuel_type': 'petrol',
 'id': '92493593-da34-586f-ad1d-814e875fe119',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX88072',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 106937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-17',
 'seller_name': None,
 'title': 'MINI John Cooper Works',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX88072%27 HTTP/1.1" 200 None
2026-03-30 09:10:30 [auto1.it] INFO: Saving data for JX88072: {'auction_closing_time': 1774884754.0, 'created_time': 1774775122.046068, 'last_price_update_time': 1774861830.775699}
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JX88072') HTTP/1.1" 204 0
2026-03-30 09:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK52144/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA03444> (referer: https://www.auto1.com/v1/car-details-view/DA03444/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF67541> (referer: https://www.auto1.com/v1/car-details-view/VF67541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ00308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9 with identifier: TJ75613
2026-03-30 09:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9 with identifier: TJ75613
2026-03-30 09:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9 with identifier: TJ75613 to the API
2026-03-30 09:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_ef2d8286c0bbbb2fb2a9a6838ac08247.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:00:34Z',
 'fuel_type': 'diesel',
 'id': 'c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ75613',
 'listing': 'auction',
 'location': 'IT, Villasanta',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 115681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_84c04a93893c9efa5403bc95c62b7f7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_221f3756b4b9fa3fb74727e95ac67af1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_ef2d8286c0bbbb2fb2a9a6838ac08247.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_262f4e36d8217eb3d3d3617986d4dc4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_cc7cc9f929337227bd93e3103d25a821.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_c57420faeeed675fb8d786299e818e8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_d22728f5b9fbea1e0c9a66a29b71da3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_474923524c14e0ad1cc194b231cb7a37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_aa4976e3f5cc7fbdac4960d304e24d5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9/c6b36be7-5e06-5e5a-9ca2-9b9486c16fd9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/27/032731624601f5029d4648d7debb516e/pa/TJ75613_a1cd309371b875dfdb960f58f19d5b1a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business BlueMotion',
 'year': 2019}
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ75613%27 HTTP/1.1" 200 None
2026-03-30 09:10:31 [auto1.it] INFO: Saving data for TJ75613: {'created_time': 1774861831.480123, 'last_price_update_time': 1774861831.480135, 'auction_closing_time': 1774969234.0}
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ75613') HTTP/1.1" 204 0
2026-03-30 09:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_65e0c8b05bd819de39524d93a9fc56aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_1d602c12912bb02e51806a6c2b33761e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:31 [auto1.it] INFO: Found listing with ID: RX56981
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX56981%27 HTTP/1.1" 200 None
2026-03-30 09:10:31 [auto1.it] INFO: Scrape type for RX56981: 2
2026-03-30 09:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66090fcf-5392-535f-8c3c-55de249de938 with identifier: RX56981
2026-03-30 09:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66090fcf-5392-535f-8c3c-55de249de938 with scrape type 2
2026-03-30 09:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66090fcf-5392-535f-8c3c-55de249de938 with scrape type 2
2026-03-30 09:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 66090fcf-5392-535f-8c3c-55de249de938, identifier: RX56981
2026-03-30 09:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ56464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_bb1e120d26d9a9d6be5f293cb6917256.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_bb1e120d26d9a9d6be5f293cb6917256.jpg not downloaded yet
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_64c6bb2944908ac94d25fc3983ea2dd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_64c6bb2944908ac94d25fc3983ea2dd2.jpg not downloaded yet
2026-03-30 09:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 66090fcf-5392-535f-8c3c-55de249de938 with identifier: RX56981
2026-03-30 09:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 66090fcf-5392-535f-8c3c-55de249de938 with identifier: RX56981
2026-03-30 09:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 66090fcf-5392-535f-8c3c-55de249de938 with identifier: RX56981 to the API
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:38:29Z',
 'fuel_type': 'petrol',
 'id': '66090fcf-5392-535f-8c3c-55de249de938',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX56981',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 168543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-15',
 'seller_name': None,
 'title': 'Nissan Micra 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2006}
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX56981%27 HTTP/1.1" 200 None
2026-03-30 09:10:31 [auto1.it] INFO: Saving data for RX56981: {'auction_closing_time': 1774885109.0, 'created_time': 1772655137.815953, 'last_price_update_time': 1774861831.951053}
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX56981') HTTP/1.1" 204 0
2026-03-30 09:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13c5e50>
2026-03-30 09:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F7f%252F4d7f5feec66c91a77001edcc9d0d35ce%252Fpa%252FSV06431_b8596ba1d3fdafa6bf473d147c79703a.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_b8596ba1d3fdafa6bf473d147c79703a.jpg saved to cache
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0152a889-6a7a-5468-9b1c-d1e66eede67f
2026-03-30 09:10:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0152a889-6a7a-5468-9b1c-d1e66eede67f, skipping ID generation
2026-03-30 09:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0152a889-6a7a-5468-9b1c-d1e66eede67f with scrape type 1
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0152a889-6a7a-5468-9b1c-d1e66eede67f sending to next pipeline
2026-03-30 09:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0152a889-6a7a-5468-9b1c-d1e66eede67f, identifier: SV06431
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25eae90>
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_b4ec5ec28771693bd67003e4d3e2d6c6.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_b4ec5ec28771693bd67003e4d3e2d6c6.jpg saved to cache
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed444c9e-7973-5740-a2a6-4deb5a19e8da
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2745790>
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_a782150cf636bddcd25a0d8086384cd4.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_a782150cf636bddcd25a0d8086384cd4.jpg saved to cache
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bab12fba-4299-517d-bba1-f5b3ed30c643
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48d0550>
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc24aaaa-1bfd-564d-8345-3dd1619b2181/fc24aaaa-1bfd-564d-8345-3dd1619b2181_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Ff2%252Fcff215083afe3839c9a42a5112f959d5%252Fpa%252FAY28860_513be43759502d6d32bb4932a8289e80.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_513be43759502d6d32bb4932a8289e80.jpg saved to cache
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc24aaaa-1bfd-564d-8345-3dd1619b2181
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2745ad0>
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_ee078871b27dd50efebef9adb4614f92.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_ee078871b27dd50efebef9adb4614f92.jpg saved to cache
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed444c9e-7973-5740-a2a6-4deb5a19e8da
2026-03-30 09:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_775c4a6995863d082be5d4702a4ba347.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:32 [auto1.it] INFO: Found listing with ID: GK78274
2026-03-30 09:10:32 [auto1.it] INFO: Found listing with ID: NB92665
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB92665%27 HTTP/1.1" 200 None
2026-03-30 09:10:32 [auto1.it] INFO: Scrape type for NB92665: 2
2026-03-30 09:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc224166-c900-54bf-8d34-524d9cec4612 with identifier: NB92665
2026-03-30 09:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc224166-c900-54bf-8d34-524d9cec4612 with scrape type 2
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc224166-c900-54bf-8d34-524d9cec4612 with scrape type 2
2026-03-30 09:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bc224166-c900-54bf-8d34-524d9cec4612, identifier: NB92665
2026-03-30 09:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0152a889-6a7a-5468-9b1c-d1e66eede67f with identifier: SV06431
2026-03-30 09:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0152a889-6a7a-5468-9b1c-d1e66eede67f with identifier: SV06431
2026-03-30 09:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0152a889-6a7a-5468-9b1c-d1e66eede67f with identifier: SV06431 to the API
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_b8596ba1d3fdafa6bf473d147c79703a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:42:37Z',
 'fuel_type': 'petrol',
 'id': '0152a889-6a7a-5468-9b1c-d1e66eede67f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV06431',
 'listing': 'auction',
 'location': 'IT, Rende',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 61761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_aa3009271e5457f88bcc052ae22671a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_accdd46df6b6fe60c3316b80d6a2da0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_c7a29e1e201634655cd1339d67f94ddd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_e074db75e63a03896c3b3531055e7ac8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_3d7fdcaa325ffbe7b6fe0efc25cbd023.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_8f5b0fa76267c19e197d40a01179308b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_b8596ba1d3fdafa6bf473d147c79703a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_ccf2ce80743a73381e7389c7a0467d75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_a23141c1ebf31c97406acf8c6a8cd2ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0152a889-6a7a-5468-9b1c-d1e66eede67f/0152a889-6a7a-5468-9b1c-d1e66eede67f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/7f/4d7f5feec66c91a77001edcc9d0d35ce/pa/SV06431_56390c950d356b35bcdce0bd4c2d5a77.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV06431%27 HTTP/1.1" 200 None
2026-03-30 09:10:32 [auto1.it] INFO: Saving data for SV06431: {'created_time': 1774861832.812939, 'last_price_update_time': 1774861832.812953, 'auction_closing_time': 1774971757.0}
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SV06431') HTTP/1.1" 204 0
2026-03-30 09:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_8944f5acf8cd83c7a109a5ae22111da5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_b27ec8ff804dd171e698b14811648c7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_3950b5e602fd8238990ced7db4e08a19.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_3950b5e602fd8238990ced7db4e08a19.jpg not downloaded yet
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_becf1d7d7632c8c326c60bc20ac9c7a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_becf1d7d7632c8c326c60bc20ac9c7a7.jpg not downloaded yet
2026-03-30 09:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bc224166-c900-54bf-8d34-524d9cec4612 with identifier: NB92665
2026-03-30 09:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bc224166-c900-54bf-8d34-524d9cec4612 with identifier: NB92665
2026-03-30 09:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bc224166-c900-54bf-8d34-524d9cec4612 with identifier: NB92665 to the API
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:40:30Z',
 'fuel_type': 'diesel',
 'id': 'bc224166-c900-54bf-8d34-524d9cec4612',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB92665',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90 Cross Country',
 'odometer': 167101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-12',
 'seller_name': None,
 'title': 'Volvo V90 Cross Country 2.0 D4 AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2017}
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB92665%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [auto1.it] INFO: Saving data for NB92665: {'auction_closing_time': 1774885230.0, 'created_time': 1774775125.122098, 'last_price_update_time': 1774861833.213065}
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NB92665') HTTP/1.1" 204 0
2026-03-30 09:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP46989> (referer: https://www.auto1.com/v1/car-details-view/AP46989/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC14157> (referer: https://www.auto1.com/v1/car-details-view/DC14157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496 with identifier: DA03444
2026-03-30 09:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496 with scrape type 1
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F8a%252Fca8a6f28ce1ad32f91a7a7e87981fb93%252Fpa%252FDA03444_82f9ae3312ab946efad7c850d0793ee7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_82f9ae3312ab946efad7c850d0793ee7.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F8a%252Fca8a6f28ce1ad32f91a7a7e87981fb93%252Fpa%252FDA03444_6a97b5db43dfbca8ce6e5529493126f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_6a97b5db43dfbca8ce6e5529493126f1.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F8a%252Fca8a6f28ce1ad32f91a7a7e87981fb93%252Fpa%252FDA03444_d3501a794748a1ee97e69d30585610fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_d3501a794748a1ee97e69d30585610fc.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F8a%252Fca8a6f28ce1ad32f91a7a7e87981fb93%252Fpa%252FDA03444_1163ff92acd2e21255a0bdff7ade0362.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_1163ff92acd2e21255a0bdff7ade0362.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F8a%252Fca8a6f28ce1ad32f91a7a7e87981fb93%252Fpa%252FDA03444_ce38bbba3a731a886bb524a1e281e290.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_ce38bbba3a731a886bb524a1e281e290.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F8a%252Fca8a6f28ce1ad32f91a7a7e87981fb93%252Fpa%252FDA03444_b814b73f4d358ffa8abc928e843891df.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_b814b73f4d358ffa8abc928e843891df.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F8a%252Fca8a6f28ce1ad32f91a7a7e87981fb93%252Fpa%252FDA03444_8b741c33b6f9b3bda6fcca15708ea246.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_8b741c33b6f9b3bda6fcca15708ea246.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F8a%252Fca8a6f28ce1ad32f91a7a7e87981fb93%252Fpa%252FDA03444_ea8e6c7ac3e1f8b085cfd9aa7c8320cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_ea8e6c7ac3e1f8b085cfd9aa7c8320cf.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F8a%252Fca8a6f28ce1ad32f91a7a7e87981fb93%252Fpa%252FDA03444_e3f28be89840ef26a6151d520e12df8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_e3f28be89840ef26a6151d520e12df8c.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F8a%252Fca8a6f28ce1ad32f91a7a7e87981fb93%252Fpa%252FDA03444_64c6c4c1481afdfc100af5b66c23074d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_64c6c4c1481afdfc100af5b66c23074d.jpg already downloaded
2026-03-30 09:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496, identifier: DA03444
2026-03-30 09:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 255d1b91-6254-5fc7-a8ea-5c3702e3dcb3 with identifier: VF67541
2026-03-30 09:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 255d1b91-6254-5fc7-a8ea-5c3702e3dcb3 with scrape type 1
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 255d1b91-6254-5fc7-a8ea-5c3702e3dcb3
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2f%252F732fc1261553fe39f8bdfc267fb8dbcd%252Fpa%252FVF67541_05229db6bc38c7e9a1816ead52c6e847.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_05229db6bc38c7e9a1816ead52c6e847.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2f%252F732fc1261553fe39f8bdfc267fb8dbcd%252Fpa%252FVF67541_7b13d15695024026b11ef5184d0848dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_7b13d15695024026b11ef5184d0848dc.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2f%252F732fc1261553fe39f8bdfc267fb8dbcd%252Fpa%252FVF67541_2b31915fe9a90f470d55fb95123f476a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_2b31915fe9a90f470d55fb95123f476a.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2f%252F732fc1261553fe39f8bdfc267fb8dbcd%252Fpa%252FVF67541_5ab1c8a9527f3acb01f9ddcdc89f1787.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_5ab1c8a9527f3acb01f9ddcdc89f1787.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2f%252F732fc1261553fe39f8bdfc267fb8dbcd%252Fpa%252FVF67541_9d6e2c87daa78e1ab9d3f56875303a75.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_9d6e2c87daa78e1ab9d3f56875303a75.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2f%252F732fc1261553fe39f8bdfc267fb8dbcd%252Fpa%252FVF67541_2768484966b2f6eda5bc1b042dd68525.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_2768484966b2f6eda5bc1b042dd68525.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2f%252F732fc1261553fe39f8bdfc267fb8dbcd%252Fpa%252FVF67541_2fa554d21881d983d3ca9a3af6991494.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_2fa554d21881d983d3ca9a3af6991494.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2f%252F732fc1261553fe39f8bdfc267fb8dbcd%252Fpa%252FVF67541_b9eddea52085f3ddcdd38f8dd0630749.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_b9eddea52085f3ddcdd38f8dd0630749.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2f%252F732fc1261553fe39f8bdfc267fb8dbcd%252Fpa%252FVF67541_7eb2555df3f7f3782cc82fd239aaa4a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_7eb2555df3f7f3782cc82fd239aaa4a9.jpg already downloaded
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F2f%252F732fc1261553fe39f8bdfc267fb8dbcd%252Fpa%252FVF67541_a4b1f46f8f8e2b69df161acd3b3f9062.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_a4b1f46f8f8e2b69df161acd3b3f9062.jpg already downloaded
2026-03-30 09:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 255d1b91-6254-5fc7-a8ea-5c3702e3dcb3, identifier: VF67541
2026-03-30 09:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24bced0>
2026-03-30 09:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_65e0c8b05bd819de39524d93a9fc56aa.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_65e0c8b05bd819de39524d93a9fc56aa.jpg saved to cache
2026-03-30 09:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bab12fba-4299-517d-bba1-f5b3ed30c643
2026-03-30 09:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13f3150>
2026-03-30 09:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc24aaaa-1bfd-564d-8345-3dd1619b2181/fc24aaaa-1bfd-564d-8345-3dd1619b2181_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Ff2%252Fcff215083afe3839c9a42a5112f959d5%252Fpa%252FAY28860_1d602c12912bb02e51806a6c2b33761e.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_1d602c12912bb02e51806a6c2b33761e.jpg saved to cache
2026-03-30 09:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc24aaaa-1bfd-564d-8345-3dd1619b2181
2026-03-30 09:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_0eeea86a11d97370db69c2ec97df413c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:34 [auto1.it] INFO: Found listing with ID: CR61657
2026-03-30 09:10:34 [auto1.it] INFO: Found listing with ID: RU81882
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU81882%27 HTTP/1.1" 200 None
2026-03-30 09:10:34 [auto1.it] INFO: Scrape type for RU81882: 2
2026-03-30 09:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a0328c8-5bdb-562b-b33d-91146250192e with identifier: RU81882
2026-03-30 09:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a0328c8-5bdb-562b-b33d-91146250192e with scrape type 2
2026-03-30 09:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a0328c8-5bdb-562b-b33d-91146250192e with scrape type 2
2026-03-30 09:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0a0328c8-5bdb-562b-b33d-91146250192e, identifier: RU81882
2026-03-30 09:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496 with identifier: DA03444
2026-03-30 09:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496 with identifier: DA03444
2026-03-30 09:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496 with identifier: DA03444 to the API
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DA03444>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:43:29Z',
 'fuel_type': 'petrol',
 'id': '6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA03444',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 204755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_82f9ae3312ab946efad7c850d0793ee7.jpg',
                'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_6a97b5db43dfbca8ce6e5529493126f1.jpg',
                'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_d3501a794748a1ee97e69d30585610fc.jpg',
                'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_1163ff92acd2e21255a0bdff7ade0362.jpg',
                'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_ce38bbba3a731a886bb524a1e281e290.jpg',
                'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_b814b73f4d358ffa8abc928e843891df.jpg',
                'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_8b741c33b6f9b3bda6fcca15708ea246.jpg',
                'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_ea8e6c7ac3e1f8b085cfd9aa7c8320cf.jpg',
                'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_e3f28be89840ef26a6151d520e12df8c.jpg',
                'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_64c6c4c1481afdfc100af5b66c23074d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496/6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_82f9ae3312ab946efad7c850d0793ee7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496/6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_6a97b5db43dfbca8ce6e5529493126f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496/6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_d3501a794748a1ee97e69d30585610fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496/6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_1163ff92acd2e21255a0bdff7ade0362.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496/6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_ce38bbba3a731a886bb524a1e281e290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496/6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_b814b73f4d358ffa8abc928e843891df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496/6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_8b741c33b6f9b3bda6fcca15708ea246.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496/6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_ea8e6c7ac3e1f8b085cfd9aa7c8320cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496/6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_e3f28be89840ef26a6151d520e12df8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496/6d82b3b6-3b2e-5a09-b33e-eed3fa0e1496_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/8a/ca8a6f28ce1ad32f91a7a7e87981fb93/pa/DA03444_64c6c4c1481afdfc100af5b66c23074d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion',
 'year': 2010}
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA03444%27 HTTP/1.1" 200 None
2026-03-30 09:10:34 [auto1.it] INFO: Saving data for DA03444: {'created_time': 1774861834.472118, 'last_price_update_time': 1774861834.47213, 'auction_closing_time': 1774971809.0}
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA03444') HTTP/1.1" 204 0
2026-03-30 09:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 255d1b91-6254-5fc7-a8ea-5c3702e3dcb3 with identifier: VF67541
2026-03-30 09:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 255d1b91-6254-5fc7-a8ea-5c3702e3dcb3 with identifier: VF67541
2026-03-30 09:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 255d1b91-6254-5fc7-a8ea-5c3702e3dcb3 with identifier: VF67541 to the API
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VF67541>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:09:38Z',
 'fuel_type': 'diesel',
 'id': '255d1b91-6254-5fc7-a8ea-5c3702e3dcb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF67541',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 76332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_05229db6bc38c7e9a1816ead52c6e847.jpg',
                'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_7b13d15695024026b11ef5184d0848dc.jpg',
                'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_2b31915fe9a90f470d55fb95123f476a.jpg',
                'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_5ab1c8a9527f3acb01f9ddcdc89f1787.jpg',
                'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_9d6e2c87daa78e1ab9d3f56875303a75.jpg',
                'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_2768484966b2f6eda5bc1b042dd68525.jpg',
                'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_2fa554d21881d983d3ca9a3af6991494.jpg',
                'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_b9eddea52085f3ddcdd38f8dd0630749.jpg',
                'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_7eb2555df3f7f3782cc82fd239aaa4a9.jpg',
                'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_a4b1f46f8f8e2b69df161acd3b3f9062.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255d1b91-6254-5fc7-a8ea-5c3702e3dcb3/255d1b91-6254-5fc7-a8ea-5c3702e3dcb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_05229db6bc38c7e9a1816ead52c6e847.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255d1b91-6254-5fc7-a8ea-5c3702e3dcb3/255d1b91-6254-5fc7-a8ea-5c3702e3dcb3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_7b13d15695024026b11ef5184d0848dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255d1b91-6254-5fc7-a8ea-5c3702e3dcb3/255d1b91-6254-5fc7-a8ea-5c3702e3dcb3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_2b31915fe9a90f470d55fb95123f476a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255d1b91-6254-5fc7-a8ea-5c3702e3dcb3/255d1b91-6254-5fc7-a8ea-5c3702e3dcb3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_5ab1c8a9527f3acb01f9ddcdc89f1787.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255d1b91-6254-5fc7-a8ea-5c3702e3dcb3/255d1b91-6254-5fc7-a8ea-5c3702e3dcb3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_9d6e2c87daa78e1ab9d3f56875303a75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255d1b91-6254-5fc7-a8ea-5c3702e3dcb3/255d1b91-6254-5fc7-a8ea-5c3702e3dcb3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_2768484966b2f6eda5bc1b042dd68525.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255d1b91-6254-5fc7-a8ea-5c3702e3dcb3/255d1b91-6254-5fc7-a8ea-5c3702e3dcb3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_2fa554d21881d983d3ca9a3af6991494.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255d1b91-6254-5fc7-a8ea-5c3702e3dcb3/255d1b91-6254-5fc7-a8ea-5c3702e3dcb3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_b9eddea52085f3ddcdd38f8dd0630749.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255d1b91-6254-5fc7-a8ea-5c3702e3dcb3/255d1b91-6254-5fc7-a8ea-5c3702e3dcb3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_7eb2555df3f7f3782cc82fd239aaa4a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_255d1b91-6254-5fc7-a8ea-5c3702e3dcb3/255d1b91-6254-5fc7-a8ea-5c3702e3dcb3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/2f/732fc1261553fe39f8bdfc267fb8dbcd/pa/VF67541_a4b1f46f8f8e2b69df161acd3b3f9062.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TDI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2022}
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF67541%27 HTTP/1.1" 200 None
2026-03-30 09:10:34 [auto1.it] INFO: Saving data for VF67541: {'created_time': 1774861834.920437, 'last_price_update_time': 1774861834.920448, 'auction_closing_time': 1774969778.0}
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VF67541') HTTP/1.1" 204 0
2026-03-30 09:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_0e2810e4db77771eb784731d1fee8b8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_d90abb7233be49ff9e3084e14480077d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_6fbcfaacc3bcd3185d2add5d1dcdde8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_60f83241a6f28006357b718aca3aadb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_60f83241a6f28006357b718aca3aadb6.jpg not downloaded yet
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_7a3845738390bd22555745392dc6bb32.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_7a3845738390bd22555745392dc6bb32.jpg not downloaded yet
2026-03-30 09:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0a0328c8-5bdb-562b-b33d-91146250192e with identifier: RU81882
2026-03-30 09:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0a0328c8-5bdb-562b-b33d-91146250192e with identifier: RU81882
2026-03-30 09:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0a0328c8-5bdb-562b-b33d-91146250192e with identifier: RU81882 to the API
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:32:23Z',
 'fuel_type': 'diesel',
 'id': '0a0328c8-5bdb-562b-b33d-91146250192e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU81882',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 91629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2017}
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU81882%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [auto1.it] INFO: Saving data for RU81882: {'auction_closing_time': 1774884743.0, 'created_time': 1774775125.455305, 'last_price_update_time': 1774861835.254868}
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU81882') HTTP/1.1" 204 0
2026-03-30 09:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT29802> (referer: https://www.auto1.com/v1/car-details-view/TT29802/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_06c97269ea43fd5ad93def6e50184e19.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_38b0595dcacc039b82b52547f19f60c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: NR76329
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: BY77891
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: FT91483
2026-03-30 09:10:35 [auto1.it] INFO: Found listing with ID: WK11111
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK11111%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [auto1.it] INFO: Scrape type for WK11111: 2
2026-03-30 09:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30c2bc19-8132-5880-b144-b4fb9aa66e37 with identifier: WK11111
2026-03-30 09:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30c2bc19-8132-5880-b144-b4fb9aa66e37 with scrape type 2
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30c2bc19-8132-5880-b144-b4fb9aa66e37 with scrape type 2
2026-03-30 09:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 30c2bc19-8132-5880-b144-b4fb9aa66e37, identifier: WK11111
2026-03-30 09:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1468f90>
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_775c4a6995863d082be5d4702a4ba347.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_775c4a6995863d082be5d4702a4ba347.jpg saved to cache
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bab12fba-4299-517d-bba1-f5b3ed30c643
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1264410>
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_8944f5acf8cd83c7a109a5ae22111da5.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_8944f5acf8cd83c7a109a5ae22111da5.jpg saved to cache
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee11b4ed0>
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc24aaaa-1bfd-564d-8345-3dd1619b2181/fc24aaaa-1bfd-564d-8345-3dd1619b2181_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Ff2%252Fcff215083afe3839c9a42a5112f959d5%252Fpa%252FAY28860_b27ec8ff804dd171e698b14811648c7b.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_b27ec8ff804dd171e698b14811648c7b.jpg saved to cache
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc24aaaa-1bfd-564d-8345-3dd1619b2181
2026-03-30 09:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aec91c30-2158-5ba2-9419-38e33eaeefd4 with identifier: AP46989
2026-03-30 09:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec91c30-2158-5ba2-9419-38e33eaeefd4 with scrape type 1
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aec91c30-2158-5ba2-9419-38e33eaeefd4
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_55389d073236f3ec3f883431196ad770.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_55389d073236f3ec3f883431196ad770.jpg not downloaded yet
2026-03-30 09:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c511151-0d4c-51b0-a9a7-147f7cf03238 with identifier: DC14157
2026-03-30 09:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c511151-0d4c-51b0-a9a7-147f7cf03238 with scrape type 1
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F06%252F0106692a74cc0bac53c9d040dae41b35%252Fpa%252FDC14157_716a7cf2560832629ac95454cf1d4176.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_716a7cf2560832629ac95454cf1d4176.jpg already downloaded
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F06%252F0106692a74cc0bac53c9d040dae41b35%252Fpa%252FDC14157_96f81c6e97bbf2112b3e39f9a0324ef6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_96f81c6e97bbf2112b3e39f9a0324ef6.jpg already downloaded
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F06%252F0106692a74cc0bac53c9d040dae41b35%252Fpa%252FDC14157_3647dc11d74e2cade2ffd1adbabed107.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_3647dc11d74e2cade2ffd1adbabed107.jpg already downloaded
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F06%252F0106692a74cc0bac53c9d040dae41b35%252Fpa%252FDC14157_b4dd542ee846f3f9ea9c54bec97fc238.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_b4dd542ee846f3f9ea9c54bec97fc238.jpg already downloaded
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F06%252F0106692a74cc0bac53c9d040dae41b35%252Fpa%252FDC14157_67a05c4c857998b45eee37b4068de39e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_67a05c4c857998b45eee37b4068de39e.jpg already downloaded
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F06%252F0106692a74cc0bac53c9d040dae41b35%252Fpa%252FDC14157_4365941974b97f55c2799f8dd3646dae.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_4365941974b97f55c2799f8dd3646dae.jpg already downloaded
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F06%252F0106692a74cc0bac53c9d040dae41b35%252Fpa%252FDC14157_444d0f4d769a0cd5d2e933b3325b3854.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_444d0f4d769a0cd5d2e933b3325b3854.jpg already downloaded
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F06%252F0106692a74cc0bac53c9d040dae41b35%252Fpa%252FDC14157_26c74c8112f46dbcaa3f4dd2c1b8ce60.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_26c74c8112f46dbcaa3f4dd2c1b8ce60.jpg already downloaded
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F06%252F0106692a74cc0bac53c9d040dae41b35%252Fpa%252FDC14157_af4a8b39217f5ca85768021cb5cee537.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_af4a8b39217f5ca85768021cb5cee537.jpg already downloaded
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F06%252F0106692a74cc0bac53c9d040dae41b35%252Fpa%252FDC14157_0d1a6e39504bf1686ce254744c6eb359.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_0d1a6e39504bf1686ce254744c6eb359.jpg already downloaded
2026-03-30 09:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c511151-0d4c-51b0-a9a7-147f7cf03238, identifier: DC14157
2026-03-30 09:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_3fa686bd0c2b1621da848d127600f1f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_4c69f4a7482985609e11c70d76c53151.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_4c69f4a7482985609e11c70d76c53151.jpg not downloaded yet
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_05d59f466973a7f3da2b1bbfa4c935ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_05d59f466973a7f3da2b1bbfa4c935ba.jpg not downloaded yet
2026-03-30 09:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 30c2bc19-8132-5880-b144-b4fb9aa66e37 with identifier: WK11111
2026-03-30 09:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 30c2bc19-8132-5880-b144-b4fb9aa66e37 with identifier: WK11111
2026-03-30 09:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 30c2bc19-8132-5880-b144-b4fb9aa66e37 with identifier: WK11111 to the API
2026-03-30 09:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:45:51Z',
 'fuel_type': 'petrol',
 'id': '30c2bc19-8132-5880-b144-b4fb9aa66e37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK11111',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 258270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-20',
 'seller_name': None,
 'title': 'Dacia Sandero 1.4 Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2010}
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK11111%27 HTTP/1.1" 200 None
2026-03-30 09:10:36 [auto1.it] INFO: Saving data for WK11111: {'auction_closing_time': 1774885551.0, 'created_time': 1774645750.50179, 'last_price_update_time': 1774861836.143758}
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WK11111') HTTP/1.1" 204 0
2026-03-30 09:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c511151-0d4c-51b0-a9a7-147f7cf03238 with identifier: DC14157
2026-03-30 09:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c511151-0d4c-51b0-a9a7-147f7cf03238 with identifier: DC14157
2026-03-30 09:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c511151-0d4c-51b0-a9a7-147f7cf03238 with identifier: DC14157 to the API
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DC14157>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '3.0L',
 'engine_horse_power': 250,
 'expiration_date': '2026-03-31T15:01:52Z',
 'fuel_type': 'diesel',
 'id': '3c511151-0d4c-51b0-a9a7-147f7cf03238',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC14157',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 158390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_716a7cf2560832629ac95454cf1d4176.jpg',
                'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_96f81c6e97bbf2112b3e39f9a0324ef6.jpg',
                'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_3647dc11d74e2cade2ffd1adbabed107.jpg',
                'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_b4dd542ee846f3f9ea9c54bec97fc238.jpg',
                'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_67a05c4c857998b45eee37b4068de39e.jpg',
                'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_4365941974b97f55c2799f8dd3646dae.jpg',
                'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_444d0f4d769a0cd5d2e933b3325b3854.jpg',
                'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_26c74c8112f46dbcaa3f4dd2c1b8ce60.jpg',
                'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_af4a8b39217f5ca85768021cb5cee537.jpg',
                'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_0d1a6e39504bf1686ce254744c6eb359.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_716a7cf2560832629ac95454cf1d4176.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2657489,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_96f81c6e97bbf2112b3e39f9a0324ef6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2492136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_3647dc11d74e2cade2ffd1adbabed107.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2782475,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_b4dd542ee846f3f9ea9c54bec97fc238.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2603823,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_67a05c4c857998b45eee37b4068de39e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2536793,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_4365941974b97f55c2799f8dd3646dae.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49881,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_444d0f4d769a0cd5d2e933b3325b3854.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2648290,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_26c74c8112f46dbcaa3f4dd2c1b8ce60.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608052,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_af4a8b39217f5ca85768021cb5cee537.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_0d1a6e39504bf1686ce254744c6eb359.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 Diesel GranLusso',
 'transmission': 'automatic',
 'trim': 'GranLusso',
 'year': 2019}
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC14157%27 HTTP/1.1" 200 None
2026-03-30 09:10:36 [auto1.it] INFO: Saving data for DC14157: {'created_time': 1774861836.503619, 'last_price_update_time': 1774861836.503628, 'auction_closing_time': 1774969312.0}
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DC14157') HTTP/1.1" 204 0
2026-03-30 09:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_e517c9140c13bc5442ec4c3cb4f128b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:36 [auto1.it] INFO: Found listing with ID: HL96914
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL96914%27 HTTP/1.1" 200 None
2026-03-30 09:10:36 [auto1.it] INFO: Scrape type for HL96914: 2
2026-03-30 09:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4380c84a-26be-5904-a7db-1b59b84d11d5 with identifier: HL96914
2026-03-30 09:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4380c84a-26be-5904-a7db-1b59b84d11d5 with scrape type 2
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4380c84a-26be-5904-a7db-1b59b84d11d5 with scrape type 2
2026-03-30 09:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4380c84a-26be-5904-a7db-1b59b84d11d5, identifier: HL96914
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_2da99b7501e55286037b6475cf0d9ffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_2da99b7501e55286037b6475cf0d9ffc.jpg not downloaded yet
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1448810>
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_0eeea86a11d97370db69c2ec97df413c.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_0eeea86a11d97370db69c2ec97df413c.jpg saved to cache
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed444c9e-7973-5740-a2a6-4deb5a19e8da
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27f9d10>
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_0e2810e4db77771eb784731d1fee8b8f.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_0e2810e4db77771eb784731d1fee8b8f.jpg saved to cache
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed444c9e-7973-5740-a2a6-4deb5a19e8da
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee267aa50>
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc24aaaa-1bfd-564d-8345-3dd1619b2181/fc24aaaa-1bfd-564d-8345-3dd1619b2181_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Ff2%252Fcff215083afe3839c9a42a5112f959d5%252Fpa%252FAY28860_d90abb7233be49ff9e3084e14480077d.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_d90abb7233be49ff9e3084e14480077d.jpg saved to cache
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc24aaaa-1bfd-564d-8345-3dd1619b2181
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1000bd0>
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_6fbcfaacc3bcd3185d2add5d1dcdde8d.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_6fbcfaacc3bcd3185d2add5d1dcdde8d.jpg saved to cache
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bab12fba-4299-517d-bba1-f5b3ed30c643
2026-03-30 09:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_b36bae9479af826ebd6cba7a3197b615.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_d314b70f9cc205f2917e1818652c51b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_d314b70f9cc205f2917e1818652c51b6.jpg not downloaded yet
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_81bbbff88ee5e9915fb3a5df07067411.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_81bbbff88ee5e9915fb3a5df07067411.jpg not downloaded yet
2026-03-30 09:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4380c84a-26be-5904-a7db-1b59b84d11d5 with identifier: HL96914
2026-03-30 09:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4380c84a-26be-5904-a7db-1b59b84d11d5 with identifier: HL96914
2026-03-30 09:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4380c84a-26be-5904-a7db-1b59b84d11d5 with identifier: HL96914 to the API
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:19:03Z',
 'fuel_type': 'petrol',
 'id': '4380c84a-26be-5904-a7db-1b59b84d11d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL96914',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 87822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-26',
 'seller_name': None,
 'title': 'Kia Rio 1.0 TGDI Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2017}
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL96914%27 HTTP/1.1" 200 None
2026-03-30 09:10:37 [auto1.it] INFO: Saving data for HL96914: {'auction_closing_time': 1774883943.0, 'created_time': 1774775126.234867, 'last_price_update_time': 1774861837.173603}
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HL96914') HTTP/1.1" 204 0
2026-03-30 09:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 510537d0-5134-5398-8be1-5ce7f7cfa81f with identifier: TT29802
2026-03-30 09:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 510537d0-5134-5398-8be1-5ce7f7cfa81f with scrape type 1
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 510537d0-5134-5398-8be1-5ce7f7cfa81f
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_62fd34cd9c75e6f0df4da343e7672f61.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_62fd34cd9c75e6f0df4da343e7672f61.jpg not downloaded yet
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26ed2d0>
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_06c97269ea43fd5ad93def6e50184e19.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_06c97269ea43fd5ad93def6e50184e19.jpg saved to cache
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bab12fba-4299-517d-bba1-f5b3ed30c643
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee258b9d0>
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_38b0595dcacc039b82b52547f19f60c6.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_38b0595dcacc039b82b52547f19f60c6.jpg saved to cache
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582
2026-03-30 09:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_18055458c0783a97dbe05aace73cd052.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_bce9899feb13d780cee4e4f27979ba7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_64c6bb2944908ac94d25fc3983ea2dd2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_bb1e120d26d9a9d6be5f293cb6917256.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:37 [auto1.it] INFO: Found listing with ID: UZ59848
2026-03-30 09:10:37 [auto1.it] INFO: Found listing with ID: MU02206
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU02206%27 HTTP/1.1" 200 None
2026-03-30 09:10:37 [auto1.it] INFO: Scrape type for MU02206: 2
2026-03-30 09:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3c65783-596a-5103-9bac-5d6dd04bb035 with identifier: MU02206
2026-03-30 09:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c65783-596a-5103-9bac-5d6dd04bb035 with scrape type 2
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3c65783-596a-5103-9bac-5d6dd04bb035 with scrape type 2
2026-03-30 09:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c3c65783-596a-5103-9bac-5d6dd04bb035, identifier: MU02206
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_b5e3b12ce028a0f28b42f9b590e3988f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_b5e3b12ce028a0f28b42f9b590e3988f.jpg not downloaded yet
2026-03-30 09:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_a7184153e064079544f8520ce96091a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c3c65783-596a-5103-9bac-5d6dd04bb035 with identifier: MU02206
2026-03-30 09:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c3c65783-596a-5103-9bac-5d6dd04bb035 with identifier: MU02206
2026-03-30 09:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c3c65783-596a-5103-9bac-5d6dd04bb035 with identifier: MU02206 to the API
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:26:07Z',
 'fuel_type': 'diesel',
 'id': 'c3c65783-596a-5103-9bac-5d6dd04bb035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU02206',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 302044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-08',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU02206%27 HTTP/1.1" 200 None
2026-03-30 09:10:37 [auto1.it] INFO: Saving data for MU02206: {'auction_closing_time': 1774884367.0, 'created_time': 1773867951.907484, 'last_price_update_time': 1774861837.865745}
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU02206') HTTP/1.1" 204 0
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_e98187b5a8ffb76fb9899e764d91a792.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_e98187b5a8ffb76fb9899e764d91a792.jpg not downloaded yet
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee126b2d0>
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc24aaaa-1bfd-564d-8345-3dd1619b2181/fc24aaaa-1bfd-564d-8345-3dd1619b2181_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Ff2%252Fcff215083afe3839c9a42a5112f959d5%252Fpa%252FAY28860_3fa686bd0c2b1621da848d127600f1f9.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_3fa686bd0c2b1621da848d127600f1f9.jpg saved to cache
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc24aaaa-1bfd-564d-8345-3dd1619b2181
2026-03-30 09:10:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc24aaaa-1bfd-564d-8345-3dd1619b2181, skipping ID generation
2026-03-30 09:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc24aaaa-1bfd-564d-8345-3dd1619b2181 with scrape type 1
2026-03-30 09:10:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc24aaaa-1bfd-564d-8345-3dd1619b2181 sending to next pipeline
2026-03-30 09:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc24aaaa-1bfd-564d-8345-3dd1619b2181, identifier: AY28860
2026-03-30 09:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee108ccd0>
2026-03-30 09:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_e517c9140c13bc5442ec4c3cb4f128b5.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_e517c9140c13bc5442ec4c3cb4f128b5.jpg saved to cache
2026-03-30 09:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582
2026-03-30 09:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_3950b5e602fd8238990ced7db4e08a19.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_becf1d7d7632c8c326c60bc20ac9c7a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:38 [auto1.it] INFO: Found listing with ID: UW33297
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW33297%27 HTTP/1.1" 200 None
2026-03-30 09:10:38 [auto1.it] INFO: Scrape type for UW33297: 2
2026-03-30 09:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5932916d-d2d0-53d9-817d-f78d10ede6db with identifier: UW33297
2026-03-30 09:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5932916d-d2d0-53d9-817d-f78d10ede6db with scrape type 2
2026-03-30 09:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5932916d-d2d0-53d9-817d-f78d10ede6db with scrape type 2
2026-03-30 09:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5932916d-d2d0-53d9-817d-f78d10ede6db, identifier: UW33297
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_27f15a7a08145a3f2f4e0a55d6d80845.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_27f15a7a08145a3f2f4e0a55d6d80845.jpg not downloaded yet
2026-03-30 09:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc24aaaa-1bfd-564d-8345-3dd1619b2181 with identifier: AY28860
2026-03-30 09:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc24aaaa-1bfd-564d-8345-3dd1619b2181 with identifier: AY28860
2026-03-30 09:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc24aaaa-1bfd-564d-8345-3dd1619b2181 with identifier: AY28860 to the API
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_3fa686bd0c2b1621da848d127600f1f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:40:25Z',
 'fuel_type': 'diesel',
 'id': 'fc24aaaa-1bfd-564d-8345-3dd1619b2181',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY28860',
 'listing': 'auction',
 'location': 'IT, San Giuliano Milanese',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 246502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc24aaaa-1bfd-564d-8345-3dd1619b2181/fc24aaaa-1bfd-564d-8345-3dd1619b2181_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_513be43759502d6d32bb4932a8289e80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc24aaaa-1bfd-564d-8345-3dd1619b2181/fc24aaaa-1bfd-564d-8345-3dd1619b2181_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_1d602c12912bb02e51806a6c2b33761e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc24aaaa-1bfd-564d-8345-3dd1619b2181/fc24aaaa-1bfd-564d-8345-3dd1619b2181_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_b27ec8ff804dd171e698b14811648c7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc24aaaa-1bfd-564d-8345-3dd1619b2181/fc24aaaa-1bfd-564d-8345-3dd1619b2181_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_3fa686bd0c2b1621da848d127600f1f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc24aaaa-1bfd-564d-8345-3dd1619b2181/fc24aaaa-1bfd-564d-8345-3dd1619b2181_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/f2/cff215083afe3839c9a42a5112f959d5/pa/AY28860_d90abb7233be49ff9e3084e14480077d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY28860%27 HTTP/1.1" 200 None
2026-03-30 09:10:39 [auto1.it] INFO: Saving data for AY28860: {'created_time': 1774861839.049437, 'last_price_update_time': 1774861839.049448, 'auction_closing_time': 1774971625.0}
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AY28860') HTTP/1.1" 204 0
2026-03-30 09:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5932916d-d2d0-53d9-817d-f78d10ede6db with identifier: UW33297
2026-03-30 09:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5932916d-d2d0-53d9-817d-f78d10ede6db with identifier: UW33297
2026-03-30 09:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5932916d-d2d0-53d9-817d-f78d10ede6db with identifier: UW33297 to the API
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:53:03Z',
 'fuel_type': 'diesel',
 'id': '5932916d-d2d0-53d9-817d-f78d10ede6db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW33297',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 281625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-12-31',
 'seller_name': None,
 'title': 'Citroen Berlingo 2.0 HDi Multispace',
 'transmission': 'manual',
 'trim': 'Multispace',
 'year': 1999}
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW33297%27 HTTP/1.1" 200 None
2026-03-30 09:10:39 [auto1.it] INFO: Saving data for UW33297: {'auction_closing_time': 1774885983.0, 'created_time': 1774645819.727697, 'last_price_update_time': 1774861839.354632}
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW33297') HTTP/1.1" 204 0
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_5bc86c4bbb257ca5119ca8cda6a1c655.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_5bc86c4bbb257ca5119ca8cda6a1c655.jpg not downloaded yet
2026-03-30 09:10:39 [auto1.it] INFO: Found listing with ID: LH51600
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH51600%27 HTTP/1.1" 200 None
2026-03-30 09:10:39 [auto1.it] INFO: Scrape type for LH51600: 2
2026-03-30 09:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bba38c4-bd53-5f36-b03e-d953dad2ba33 with identifier: LH51600
2026-03-30 09:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bba38c4-bd53-5f36-b03e-d953dad2ba33 with scrape type 2
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bba38c4-bd53-5f36-b03e-d953dad2ba33 with scrape type 2
2026-03-30 09:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0bba38c4-bd53-5f36-b03e-d953dad2ba33, identifier: LH51600
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_920563f4b5041eb2b82e2e91030583db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_920563f4b5041eb2b82e2e91030583db.jpg not downloaded yet
2026-03-30 09:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ56464> (referer: https://www.auto1.com/v1/car-details-view/BJ56464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ00308> (referer: https://www.auto1.com/v1/car-details-view/JJ00308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK52144> (referer: https://www.auto1.com/v1/car-details-view/TK52144/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24a5810>
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_b36bae9479af826ebd6cba7a3197b615.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_b36bae9479af826ebd6cba7a3197b615.jpg saved to cache
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed444c9e-7973-5740-a2a6-4deb5a19e8da
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fa3bd0>
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fd8%252F10d8452811c80f79aa2c41438fcd1c6a%252Fpa%252FEC84156_18055458c0783a97dbe05aace73cd052.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_18055458c0783a97dbe05aace73cd052.jpg saved to cache
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed444c9e-7973-5740-a2a6-4deb5a19e8da
2026-03-30 09:10:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed444c9e-7973-5740-a2a6-4deb5a19e8da, skipping ID generation
2026-03-30 09:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed444c9e-7973-5740-a2a6-4deb5a19e8da with scrape type 1
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed444c9e-7973-5740-a2a6-4deb5a19e8da sending to next pipeline
2026-03-30 09:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ed444c9e-7973-5740-a2a6-4deb5a19e8da, identifier: EC84156
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2879b90>
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_bce9899feb13d780cee4e4f27979ba7e.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_bce9899feb13d780cee4e4f27979ba7e.jpg saved to cache
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fa0b10>
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_64c6bb2944908ac94d25fc3983ea2dd2.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_64c6bb2944908ac94d25fc3983ea2dd2.jpg saved to cache
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bab12fba-4299-517d-bba1-f5b3ed30c643
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee270a410>
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_bb1e120d26d9a9d6be5f293cb6917256.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_bb1e120d26d9a9d6be5f293cb6917256.jpg saved to cache
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13270d0>
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_a7184153e064079544f8520ce96091a2.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_a7184153e064079544f8520ce96091a2.jpg saved to cache
2026-03-30 09:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85
2026-03-30 09:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_78967709b75c0c2f71daedb82552ddf6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_55389d073236f3ec3f883431196ad770.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_7a3845738390bd22555745392dc6bb32.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_05d59f466973a7f3da2b1bbfa4c935ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0bba38c4-bd53-5f36-b03e-d953dad2ba33 with identifier: LH51600
2026-03-30 09:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0bba38c4-bd53-5f36-b03e-d953dad2ba33 with identifier: LH51600
2026-03-30 09:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0bba38c4-bd53-5f36-b03e-d953dad2ba33 with identifier: LH51600 to the API
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:02:15Z',
 'fuel_type': 'diesel',
 'id': '0bba38c4-bd53-5f36-b03e-d953dad2ba33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH51600',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 109149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-08',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH51600%27 HTTP/1.1" 200 None
2026-03-30 09:10:40 [auto1.it] INFO: Saving data for LH51600: {'auction_closing_time': 1774882935.0, 'created_time': 1774775128.076783, 'last_price_update_time': 1774861840.261262}
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LH51600') HTTP/1.1" 204 0
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_812444c7bedb5fe5d275b065668bd1b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_812444c7bedb5fe5d275b065668bd1b9.jpg not downloaded yet
2026-03-30 09:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ed444c9e-7973-5740-a2a6-4deb5a19e8da with identifier: EC84156
2026-03-30 09:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ed444c9e-7973-5740-a2a6-4deb5a19e8da with identifier: EC84156
2026-03-30 09:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ed444c9e-7973-5740-a2a6-4deb5a19e8da with identifier: EC84156 to the API
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_18055458c0783a97dbe05aace73cd052.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:06:08Z',
 'fuel_type': 'diesel',
 'id': 'ed444c9e-7973-5740-a2a6-4deb5a19e8da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC84156',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 135833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_091c5d83290c0867ef92927e9057874b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_3832fbbfb80daaf8b30b3376f7faaa01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_91650698165cb98a08bdfae7e15c2db6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_bda8483e4867f059ce1ccc17d3214e35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_b4ec5ec28771693bd67003e4d3e2d6c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_ee078871b27dd50efebef9adb4614f92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_b36bae9479af826ebd6cba7a3197b615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_0eeea86a11d97370db69c2ec97df413c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_18055458c0783a97dbe05aace73cd052.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed444c9e-7973-5740-a2a6-4deb5a19e8da/ed444c9e-7973-5740-a2a6-4deb5a19e8da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/d8/10d8452811c80f79aa2c41438fcd1c6a/pa/EC84156_0e2810e4db77771eb784731d1fee8b8f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2014}
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC84156%27 HTTP/1.1" 200 None
2026-03-30 09:10:40 [auto1.it] INFO: Saving data for EC84156: {'created_time': 1774861840.799176, 'last_price_update_time': 1774861840.799191, 'auction_closing_time': 1774969568.0}
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC84156') HTTP/1.1" 204 0
2026-03-30 09:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_81bbbff88ee5e9915fb3a5df07067411.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_d314b70f9cc205f2917e1818652c51b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:40 [auto1.it] INFO: Found listing with ID: CW23550
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW23550%27 HTTP/1.1" 200 None
2026-03-30 09:10:40 [auto1.it] INFO: Scrape type for CW23550: 2
2026-03-30 09:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98e86690-efae-5866-8463-82ccfd9cd3d8 with identifier: CW23550
2026-03-30 09:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98e86690-efae-5866-8463-82ccfd9cd3d8 with scrape type 2
2026-03-30 09:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98e86690-efae-5866-8463-82ccfd9cd3d8 with scrape type 2
2026-03-30 09:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 98e86690-efae-5866-8463-82ccfd9cd3d8, identifier: CW23550
2026-03-30 09:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_89fff3ebaebdd84c6d82084545819dd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_89fff3ebaebdd84c6d82084545819dd3.jpg not downloaded yet
2026-03-30 09:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1128650>
2026-03-30 09:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_3950b5e602fd8238990ced7db4e08a19.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_3950b5e602fd8238990ced7db4e08a19.jpg saved to cache
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582
2026-03-30 09:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee144bd50>
2026-03-30 09:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_becf1d7d7632c8c326c60bc20ac9c7a7.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_becf1d7d7632c8c326c60bc20ac9c7a7.jpg saved to cache
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bab12fba-4299-517d-bba1-f5b3ed30c643
2026-03-30 09:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 98e86690-efae-5866-8463-82ccfd9cd3d8 with identifier: CW23550
2026-03-30 09:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 98e86690-efae-5866-8463-82ccfd9cd3d8 with identifier: CW23550
2026-03-30 09:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 98e86690-efae-5866-8463-82ccfd9cd3d8 with identifier: CW23550 to the API
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:44:23Z',
 'fuel_type': 'petrol',
 'id': '98e86690-efae-5866-8463-82ccfd9cd3d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW23550',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 35476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW23550%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [auto1.it] INFO: Saving data for CW23550: {'auction_closing_time': 1774885463.0, 'created_time': 1774775128.41918, 'last_price_update_time': 1774861841.472364}
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CW23550') HTTP/1.1" 204 0
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_63564c305b591675a1c769ac3b4f8db1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_63564c305b591675a1c769ac3b4f8db1.jpg not downloaded yet
2026-03-30 09:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7511c43-1603-5f06-9288-00d5e3acd40e with identifier: BJ56464
2026-03-30 09:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7511c43-1603-5f06-9288-00d5e3acd40e with scrape type 1
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7511c43-1603-5f06-9288-00d5e3acd40e
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F95%252F2895823db415f7e548e1ee58c9a769fe%252Fpa%252FBJ56464_34d62b6f52a7b8d9c4a041cc2f56c15c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_34d62b6f52a7b8d9c4a041cc2f56c15c.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F95%252F2895823db415f7e548e1ee58c9a769fe%252Fpa%252FBJ56464_7258799d3ba16ba6e8b09ffeb5e588d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_7258799d3ba16ba6e8b09ffeb5e588d8.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F95%252F2895823db415f7e548e1ee58c9a769fe%252Fpa%252FBJ56464_02432714b285a168837db3f32071339e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_02432714b285a168837db3f32071339e.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F95%252F2895823db415f7e548e1ee58c9a769fe%252Fpa%252FBJ56464_ca81c310db50aafb7d862a6322c76ed1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_ca81c310db50aafb7d862a6322c76ed1.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F95%252F2895823db415f7e548e1ee58c9a769fe%252Fpa%252FBJ56464_6138f92036b4e90e9690b0bdf32ddb6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_6138f92036b4e90e9690b0bdf32ddb6d.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F95%252F2895823db415f7e548e1ee58c9a769fe%252Fpa%252FBJ56464_8c6c83d2d275688e13a4db79d70bdc45.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_8c6c83d2d275688e13a4db79d70bdc45.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F95%252F2895823db415f7e548e1ee58c9a769fe%252Fpa%252FBJ56464_51715fa7ca36bff2e8a02bd1fc6c389a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_51715fa7ca36bff2e8a02bd1fc6c389a.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F95%252F2895823db415f7e548e1ee58c9a769fe%252Fpa%252FBJ56464_33fcf5ef765f32618beba6d744d42943.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_33fcf5ef765f32618beba6d744d42943.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F95%252F2895823db415f7e548e1ee58c9a769fe%252Fpa%252FBJ56464_2817b16da14a05351da617a43edd9ffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_2817b16da14a05351da617a43edd9ffc.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F95%252F2895823db415f7e548e1ee58c9a769fe%252Fpa%252FBJ56464_ea2e4e03ae6428ca32a13795ab8b27b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_ea2e4e03ae6428ca32a13795ab8b27b8.jpg already downloaded
2026-03-30 09:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7511c43-1603-5f06-9288-00d5e3acd40e, identifier: BJ56464
2026-03-30 09:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e49a26eb-ffee-5f97-8c8d-303dd1a230dc with identifier: JJ00308
2026-03-30 09:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e49a26eb-ffee-5f97-8c8d-303dd1a230dc with scrape type 1
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e49a26eb-ffee-5f97-8c8d-303dd1a230dc
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb5%252F54b581804094e51bd8dcf2c27f5b02ef%252Fpa%252FJJ00308_c3afa952bbc3182128e56d1e3162091e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_c3afa952bbc3182128e56d1e3162091e.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb5%252F54b581804094e51bd8dcf2c27f5b02ef%252Fpa%252FJJ00308_8b5f641f728a74ce7b11ac07e7f9f451.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_8b5f641f728a74ce7b11ac07e7f9f451.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb5%252F54b581804094e51bd8dcf2c27f5b02ef%252Fpa%252FJJ00308_c02aa3da445ef934df57d87ad0c55c6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_c02aa3da445ef934df57d87ad0c55c6d.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb5%252F54b581804094e51bd8dcf2c27f5b02ef%252Fpa%252FJJ00308_a523aeb3002e570f80fe40ab6d1cea3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_a523aeb3002e570f80fe40ab6d1cea3f.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb5%252F54b581804094e51bd8dcf2c27f5b02ef%252Fpa%252FJJ00308_20dbf6505786539c327413fc2de4a412.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_20dbf6505786539c327413fc2de4a412.jpg already downloaded
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb5%252F54b581804094e51bd8dcf2c27f5b02ef%252Fpa%252FJJ00308_0343d59bc3fd9ed3f160d43ebde50f09.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_0343d59bc3fd9ed3f160d43ebde50f09.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb5%252F54b581804094e51bd8dcf2c27f5b02ef%252Fpa%252FJJ00308_f4346123318724cfd4e5070fcdba0e77.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_f4346123318724cfd4e5070fcdba0e77.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb5%252F54b581804094e51bd8dcf2c27f5b02ef%252Fpa%252FJJ00308_539f094980f422218e67b05f3778f6de.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_539f094980f422218e67b05f3778f6de.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb5%252F54b581804094e51bd8dcf2c27f5b02ef%252Fpa%252FJJ00308_8aa71f08d6b1b288dfe840aa92b77c93.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_8aa71f08d6b1b288dfe840aa92b77c93.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb5%252F54b581804094e51bd8dcf2c27f5b02ef%252Fpa%252FJJ00308_c1899a1e203ff7602c6a2d441fcd5ef9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_c1899a1e203ff7602c6a2d441fcd5ef9.jpg already downloaded
2026-03-30 09:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e49a26eb-ffee-5f97-8c8d-303dd1a230dc, identifier: JJ00308
2026-03-30 09:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82142e83-9f56-5688-b53b-7d31274fd3ce with identifier: TK52144
2026-03-30 09:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82142e83-9f56-5688-b53b-7d31274fd3ce with scrape type 1
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82142e83-9f56-5688-b53b-7d31274fd3ce
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fe9%252F64e9a183353c54a8156085a054ba0d94%252Fpa%252FTK52144_91606e10c52903dad404860e51e4e098.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_91606e10c52903dad404860e51e4e098.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fe9%252F64e9a183353c54a8156085a054ba0d94%252Fpa%252FTK52144_2f59e57cf79e4d3bfe136ad056b85a98.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_2f59e57cf79e4d3bfe136ad056b85a98.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fe9%252F64e9a183353c54a8156085a054ba0d94%252Fpa%252FTK52144_1cdc3f01b89ae3379463e1e39933c23a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_1cdc3f01b89ae3379463e1e39933c23a.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fe9%252F64e9a183353c54a8156085a054ba0d94%252Fpa%252FTK52144_52dcb6da7ce2d6423df5a3e403505260.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_52dcb6da7ce2d6423df5a3e403505260.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fe9%252F64e9a183353c54a8156085a054ba0d94%252Fpa%252FTK52144_8b460e9ca819e7aaba6cf51aa3800282.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_8b460e9ca819e7aaba6cf51aa3800282.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fe9%252F64e9a183353c54a8156085a054ba0d94%252Fpa%252FTK52144_0eef7c738ff49c71c8ebcddd232a6597.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_0eef7c738ff49c71c8ebcddd232a6597.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fe9%252F64e9a183353c54a8156085a054ba0d94%252Fpa%252FTK52144_0452c46071318c1606f23c7cb27b2480.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_0452c46071318c1606f23c7cb27b2480.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fe9%252F64e9a183353c54a8156085a054ba0d94%252Fpa%252FTK52144_40cc116a964e706c21b1432ca20c6748.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_40cc116a964e706c21b1432ca20c6748.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fe9%252F64e9a183353c54a8156085a054ba0d94%252Fpa%252FTK52144_3234d42e0270bbe278edc6f4460c67cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_3234d42e0270bbe278edc6f4460c67cf.jpg already downloaded
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fe9%252F64e9a183353c54a8156085a054ba0d94%252Fpa%252FTK52144_8dbd21d092939cf5e25d57f0d3f8be59.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_8dbd21d092939cf5e25d57f0d3f8be59.jpg already downloaded
2026-03-30 09:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82142e83-9f56-5688-b53b-7d31274fd3ce, identifier: TK52144
2026-03-30 09:10:42 [auto1.it] INFO: Found listing with ID: DZ80898
2026-03-30 09:10:42 [auto1.it] INFO: Found listing with ID: PK60217
2026-03-30 09:10:42 [auto1.it] INFO: Found listing with ID: VL28200
2026-03-30 09:10:42 [auto1.it] INFO: Found listing with ID: YV65594
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV65594%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [auto1.it] INFO: Scrape type for YV65594: 2
2026-03-30 09:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with identifier: YV65594
2026-03-30 09:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with scrape type 2
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with scrape type 2
2026-03-30 09:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a, identifier: YV65594
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_1670ad55bbf26f847cf809b3eac8290f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_1670ad55bbf26f847cf809b3eac8290f.jpg not downloaded yet
2026-03-30 09:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7511c43-1603-5f06-9288-00d5e3acd40e with identifier: BJ56464
2026-03-30 09:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7511c43-1603-5f06-9288-00d5e3acd40e with identifier: BJ56464
2026-03-30 09:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d7511c43-1603-5f06-9288-00d5e3acd40e with identifier: BJ56464 to the API
2026-03-30 09:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BJ56464>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:41:59Z',
 'fuel_type': 'diesel',
 'id': 'd7511c43-1603-5f06-9288-00d5e3acd40e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ56464',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 161887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_34d62b6f52a7b8d9c4a041cc2f56c15c.jpg',
                'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_7258799d3ba16ba6e8b09ffeb5e588d8.jpg',
                'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_02432714b285a168837db3f32071339e.jpg',
                'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_ca81c310db50aafb7d862a6322c76ed1.jpg',
                'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_6138f92036b4e90e9690b0bdf32ddb6d.jpg',
                'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_8c6c83d2d275688e13a4db79d70bdc45.jpg',
                'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_51715fa7ca36bff2e8a02bd1fc6c389a.jpg',
                'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_33fcf5ef765f32618beba6d744d42943.jpg',
                'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_2817b16da14a05351da617a43edd9ffc.jpg',
                'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_ea2e4e03ae6428ca32a13795ab8b27b8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7511c43-1603-5f06-9288-00d5e3acd40e/d7511c43-1603-5f06-9288-00d5e3acd40e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_34d62b6f52a7b8d9c4a041cc2f56c15c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7511c43-1603-5f06-9288-00d5e3acd40e/d7511c43-1603-5f06-9288-00d5e3acd40e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_7258799d3ba16ba6e8b09ffeb5e588d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7511c43-1603-5f06-9288-00d5e3acd40e/d7511c43-1603-5f06-9288-00d5e3acd40e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_02432714b285a168837db3f32071339e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7511c43-1603-5f06-9288-00d5e3acd40e/d7511c43-1603-5f06-9288-00d5e3acd40e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_ca81c310db50aafb7d862a6322c76ed1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7511c43-1603-5f06-9288-00d5e3acd40e/d7511c43-1603-5f06-9288-00d5e3acd40e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_6138f92036b4e90e9690b0bdf32ddb6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7511c43-1603-5f06-9288-00d5e3acd40e/d7511c43-1603-5f06-9288-00d5e3acd40e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_8c6c83d2d275688e13a4db79d70bdc45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7511c43-1603-5f06-9288-00d5e3acd40e/d7511c43-1603-5f06-9288-00d5e3acd40e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_51715fa7ca36bff2e8a02bd1fc6c389a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7511c43-1603-5f06-9288-00d5e3acd40e/d7511c43-1603-5f06-9288-00d5e3acd40e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_33fcf5ef765f32618beba6d744d42943.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7511c43-1603-5f06-9288-00d5e3acd40e/d7511c43-1603-5f06-9288-00d5e3acd40e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_2817b16da14a05351da617a43edd9ffc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7511c43-1603-5f06-9288-00d5e3acd40e/d7511c43-1603-5f06-9288-00d5e3acd40e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/95/2895823db415f7e548e1ee58c9a769fe/pa/BJ56464_ea2e4e03ae6428ca32a13795ab8b27b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2019}
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ56464%27 HTTP/1.1" 200 None
2026-03-30 09:10:43 [auto1.it] INFO: Saving data for BJ56464: {'created_time': 1774861843.246152, 'last_price_update_time': 1774861843.246164, 'auction_closing_time': 1774971719.0}
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ56464') HTTP/1.1" 204 0
2026-03-30 09:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e49a26eb-ffee-5f97-8c8d-303dd1a230dc with identifier: JJ00308
2026-03-30 09:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e49a26eb-ffee-5f97-8c8d-303dd1a230dc with identifier: JJ00308
2026-03-30 09:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e49a26eb-ffee-5f97-8c8d-303dd1a230dc with identifier: JJ00308 to the API
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JJ00308>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 285,
 'expiration_date': '2026-03-31T15:23:50Z',
 'fuel_type': 'diesel',
 'id': 'e49a26eb-ffee-5f97-8c8d-303dd1a230dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ00308',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 170073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_c3afa952bbc3182128e56d1e3162091e.jpg',
                'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_8b5f641f728a74ce7b11ac07e7f9f451.jpg',
                'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_c02aa3da445ef934df57d87ad0c55c6d.jpg',
                'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_a523aeb3002e570f80fe40ab6d1cea3f.jpg',
                'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_20dbf6505786539c327413fc2de4a412.jpg',
                'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_0343d59bc3fd9ed3f160d43ebde50f09.jpg',
                'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_f4346123318724cfd4e5070fcdba0e77.jpg',
                'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_539f094980f422218e67b05f3778f6de.jpg',
                'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_8aa71f08d6b1b288dfe840aa92b77c93.jpg',
                'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_c1899a1e203ff7602c6a2d441fcd5ef9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49a26eb-ffee-5f97-8c8d-303dd1a230dc/e49a26eb-ffee-5f97-8c8d-303dd1a230dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_c3afa952bbc3182128e56d1e3162091e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49a26eb-ffee-5f97-8c8d-303dd1a230dc/e49a26eb-ffee-5f97-8c8d-303dd1a230dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_8b5f641f728a74ce7b11ac07e7f9f451.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49a26eb-ffee-5f97-8c8d-303dd1a230dc/e49a26eb-ffee-5f97-8c8d-303dd1a230dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_c02aa3da445ef934df57d87ad0c55c6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49a26eb-ffee-5f97-8c8d-303dd1a230dc/e49a26eb-ffee-5f97-8c8d-303dd1a230dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_a523aeb3002e570f80fe40ab6d1cea3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49a26eb-ffee-5f97-8c8d-303dd1a230dc/e49a26eb-ffee-5f97-8c8d-303dd1a230dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_20dbf6505786539c327413fc2de4a412.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49a26eb-ffee-5f97-8c8d-303dd1a230dc/e49a26eb-ffee-5f97-8c8d-303dd1a230dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_0343d59bc3fd9ed3f160d43ebde50f09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49a26eb-ffee-5f97-8c8d-303dd1a230dc/e49a26eb-ffee-5f97-8c8d-303dd1a230dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2490987,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_f4346123318724cfd4e5070fcdba0e77.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49a26eb-ffee-5f97-8c8d-303dd1a230dc/e49a26eb-ffee-5f97-8c8d-303dd1a230dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2687125,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_539f094980f422218e67b05f3778f6de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49a26eb-ffee-5f97-8c8d-303dd1a230dc/e49a26eb-ffee-5f97-8c8d-303dd1a230dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2699207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_8aa71f08d6b1b288dfe840aa92b77c93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e49a26eb-ffee-5f97-8c8d-303dd1a230dc/e49a26eb-ffee-5f97-8c8d-303dd1a230dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/b5/54b581804094e51bd8dcf2c27f5b02ef/pa/JJ00308_c1899a1e203ff7602c6a2d441fcd5ef9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ00308%27 HTTP/1.1" 200 None
2026-03-30 09:10:43 [auto1.it] INFO: Saving data for JJ00308: {'created_time': 1774861843.769051, 'last_price_update_time': 1774861843.76906, 'auction_closing_time': 1774970630.0}
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JJ00308') HTTP/1.1" 204 0
2026-03-30 09:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82142e83-9f56-5688-b53b-7d31274fd3ce with identifier: TK52144
2026-03-30 09:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82142e83-9f56-5688-b53b-7d31274fd3ce with identifier: TK52144
2026-03-30 09:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82142e83-9f56-5688-b53b-7d31274fd3ce with identifier: TK52144 to the API
2026-03-30 09:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TK52144>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:57:01Z',
 'fuel_type': 'diesel',
 'id': '82142e83-9f56-5688-b53b-7d31274fd3ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK52144',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 163291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_91606e10c52903dad404860e51e4e098.jpg',
                'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_2f59e57cf79e4d3bfe136ad056b85a98.jpg',
                'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_1cdc3f01b89ae3379463e1e39933c23a.jpg',
                'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_52dcb6da7ce2d6423df5a3e403505260.jpg',
                'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_8b460e9ca819e7aaba6cf51aa3800282.jpg',
                'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_0eef7c738ff49c71c8ebcddd232a6597.jpg',
                'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_0452c46071318c1606f23c7cb27b2480.jpg',
                'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_40cc116a964e706c21b1432ca20c6748.jpg',
                'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_3234d42e0270bbe278edc6f4460c67cf.jpg',
                'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_8dbd21d092939cf5e25d57f0d3f8be59.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82142e83-9f56-5688-b53b-7d31274fd3ce/82142e83-9f56-5688-b53b-7d31274fd3ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_91606e10c52903dad404860e51e4e098.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82142e83-9f56-5688-b53b-7d31274fd3ce/82142e83-9f56-5688-b53b-7d31274fd3ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_2f59e57cf79e4d3bfe136ad056b85a98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82142e83-9f56-5688-b53b-7d31274fd3ce/82142e83-9f56-5688-b53b-7d31274fd3ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_1cdc3f01b89ae3379463e1e39933c23a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82142e83-9f56-5688-b53b-7d31274fd3ce/82142e83-9f56-5688-b53b-7d31274fd3ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_52dcb6da7ce2d6423df5a3e403505260.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82142e83-9f56-5688-b53b-7d31274fd3ce/82142e83-9f56-5688-b53b-7d31274fd3ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_8b460e9ca819e7aaba6cf51aa3800282.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82142e83-9f56-5688-b53b-7d31274fd3ce/82142e83-9f56-5688-b53b-7d31274fd3ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_0eef7c738ff49c71c8ebcddd232a6597.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82142e83-9f56-5688-b53b-7d31274fd3ce/82142e83-9f56-5688-b53b-7d31274fd3ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_0452c46071318c1606f23c7cb27b2480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82142e83-9f56-5688-b53b-7d31274fd3ce/82142e83-9f56-5688-b53b-7d31274fd3ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_40cc116a964e706c21b1432ca20c6748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82142e83-9f56-5688-b53b-7d31274fd3ce/82142e83-9f56-5688-b53b-7d31274fd3ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_3234d42e0270bbe278edc6f4460c67cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82142e83-9f56-5688-b53b-7d31274fd3ce/82142e83-9f56-5688-b53b-7d31274fd3ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/e9/64e9a183353c54a8156085a054ba0d94/pa/TK52144_8dbd21d092939cf5e25d57f0d3f8be59.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK52144%27 HTTP/1.1" 200 None
2026-03-30 09:10:44 [auto1.it] INFO: Saving data for TK52144: {'created_time': 1774861844.349722, 'last_price_update_time': 1774861844.349731, 'auction_closing_time': 1774972621.0}
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TK52144') HTTP/1.1" 204 0
2026-03-30 09:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_5bc86c4bbb257ca5119ca8cda6a1c655.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_2da99b7501e55286037b6475cf0d9ffc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_b5e3b12ce028a0f28b42f9b590e3988f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_60f83241a6f28006357b718aca3aadb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with identifier: YV65594
2026-03-30 09:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with identifier: YV65594
2026-03-30 09:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with identifier: YV65594 to the API
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-30T15:14:47Z',
 'fuel_type': 'diesel',
 'id': '3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV65594',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Phedra',
 'odometer': 155044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-24',
 'seller_name': None,
 'title': 'Lancia Phedra 2.0 JTD Emblema Comfortronic',
 'transmission': 'automatic',
 'trim': 'Emblema Comfortronic',
 'year': 2004}
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV65594%27 HTTP/1.1" 200 None
2026-03-30 09:10:44 [auto1.it] INFO: Saving data for YV65594: {'auction_closing_time': 1774883687.0, 'created_time': 1773129478.123779, 'last_price_update_time': 1774861844.662286}
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YV65594') HTTP/1.1" 204 0
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_d2d7910f3982abb9508be4422aa113b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_d2d7910f3982abb9508be4422aa113b0.jpg not downloaded yet
2026-03-30 09:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee280b110>
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_78967709b75c0c2f71daedb82552ddf6.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_78967709b75c0c2f71daedb82552ddf6.jpg saved to cache
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2776e10>
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_55389d073236f3ec3f883431196ad770.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_55389d073236f3ec3f883431196ad770.jpg saved to cache
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aec91c30-2158-5ba2-9419-38e33eaeefd4
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25705d0>
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_7a3845738390bd22555745392dc6bb32.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_7a3845738390bd22555745392dc6bb32.jpg saved to cache
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bab12fba-4299-517d-bba1-f5b3ed30c643
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee258a250>
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_05d59f466973a7f3da2b1bbfa4c935ba.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_05d59f466973a7f3da2b1bbfa4c935ba.jpg saved to cache
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bab12fba-4299-517d-bba1-f5b3ed30c643
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1452610>
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Fcf%252F4bcf592db670ebfc741b5a2f44d6e640%252Fpa%252FDJ29974_81bbbff88ee5e9915fb3a5df07067411.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_81bbbff88ee5e9915fb3a5df07067411.jpg saved to cache
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bab12fba-4299-517d-bba1-f5b3ed30c643
2026-03-30 09:10:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bab12fba-4299-517d-bba1-f5b3ed30c643, skipping ID generation
2026-03-30 09:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bab12fba-4299-517d-bba1-f5b3ed30c643 with scrape type 1
2026-03-30 09:10:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bab12fba-4299-517d-bba1-f5b3ed30c643 sending to next pipeline
2026-03-30 09:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bab12fba-4299-517d-bba1-f5b3ed30c643, identifier: DJ29974
2026-03-30 09:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2648fd0>
2026-03-30 09:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_d314b70f9cc205f2917e1818652c51b6.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_d314b70f9cc205f2917e1818652c51b6.jpg saved to cache
2026-03-30 09:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582
2026-03-30 09:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_27f15a7a08145a3f2f4e0a55d6d80845.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:45 [auto1.it] INFO: Found listing with ID: UV62618
2026-03-30 09:10:45 [auto1.it] INFO: Found listing with ID: ME67142
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME67142%27 HTTP/1.1" 200 None
2026-03-30 09:10:45 [auto1.it] INFO: Scrape type for ME67142: 2
2026-03-30 09:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eef696a4-1566-566c-890c-428581ba8c74 with identifier: ME67142
2026-03-30 09:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eef696a4-1566-566c-890c-428581ba8c74 with scrape type 2
2026-03-30 09:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eef696a4-1566-566c-890c-428581ba8c74 with scrape type 2
2026-03-30 09:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eef696a4-1566-566c-890c-428581ba8c74, identifier: ME67142
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_3ec1e36216fb23a790c146049e5506a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_3ec1e36216fb23a790c146049e5506a0.jpg not downloaded yet
2026-03-30 09:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bab12fba-4299-517d-bba1-f5b3ed30c643 with identifier: DJ29974
2026-03-30 09:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bab12fba-4299-517d-bba1-f5b3ed30c643 with identifier: DJ29974
2026-03-30 09:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bab12fba-4299-517d-bba1-f5b3ed30c643 with identifier: DJ29974 to the API
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_81bbbff88ee5e9915fb3a5df07067411.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 83,
 'expiration_date': '2026-03-31T15:58:18Z',
 'fuel_type': 'petrol',
 'id': 'bab12fba-4299-517d-bba1-f5b3ed30c643',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ29974',
 'listing': 'auction',
 'location': 'IT, Foggia',
 'make': 'Mahindra',
 'model': 'KUV 100',
 'odometer': 48399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_a782150cf636bddcd25a0d8086384cd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_65e0c8b05bd819de39524d93a9fc56aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_775c4a6995863d082be5d4702a4ba347.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_06c97269ea43fd5ad93def6e50184e19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_6fbcfaacc3bcd3185d2add5d1dcdde8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_64c6bb2944908ac94d25fc3983ea2dd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_becf1d7d7632c8c326c60bc20ac9c7a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_7a3845738390bd22555745392dc6bb32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_05d59f466973a7f3da2b1bbfa4c935ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bab12fba-4299-517d-bba1-f5b3ed30c643/bab12fba-4299-517d-bba1-f5b3ed30c643_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/cf/4bcf592db670ebfc741b5a2f44d6e640/pa/DJ29974_81bbbff88ee5e9915fb3a5df07067411.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mahindra KUV 100 1.2 K8',
 'transmission': 'manual',
 'trim': 'K8',
 'year': 2018}
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ29974%27 HTTP/1.1" 200 None
2026-03-30 09:10:45 [auto1.it] INFO: Saving data for DJ29974: {'created_time': 1774861845.63896, 'last_price_update_time': 1774861845.638968, 'auction_closing_time': 1774972698.0}
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DJ29974') HTTP/1.1" 204 0
2026-03-30 09:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eef696a4-1566-566c-890c-428581ba8c74 with identifier: ME67142
2026-03-30 09:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eef696a4-1566-566c-890c-428581ba8c74 with identifier: ME67142
2026-03-30 09:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eef696a4-1566-566c-890c-428581ba8c74 with identifier: ME67142 to the API
2026-03-30 09:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:37:00Z',
 'fuel_type': 'petrol',
 'id': 'eef696a4-1566-566c-890c-428581ba8c74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME67142',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Qubo',
 'odometer': 251573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-31',
 'seller_name': None,
 'title': 'Fiat Qubo 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME67142%27 HTTP/1.1" 200 None
2026-03-30 09:10:46 [auto1.it] INFO: Saving data for ME67142: {'auction_closing_time': 1774885020.0, 'created_time': 1774559503.45597, 'last_price_update_time': 1774861846.647145}
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ME67142') HTTP/1.1" 204 0
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_e5841de4a9133c58d7922d083604e54e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_e5841de4a9133c58d7922d083604e54e.jpg not downloaded yet
2026-03-30 09:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_920563f4b5041eb2b82e2e91030583db.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_704bc7802ee63b9456be5aa0db0047f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:46 [auto1.it] INFO: Found listing with ID: EH68061
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH68061%27 HTTP/1.1" 200 None
2026-03-30 09:10:46 [auto1.it] INFO: Scrape type for EH68061: 2
2026-03-30 09:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3019aad2-5e58-52c4-9624-01f04959b28d with identifier: EH68061
2026-03-30 09:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3019aad2-5e58-52c4-9624-01f04959b28d with scrape type 2
2026-03-30 09:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3019aad2-5e58-52c4-9624-01f04959b28d with scrape type 2
2026-03-30 09:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3019aad2-5e58-52c4-9624-01f04959b28d, identifier: EH68061
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_6d258db8e7cbfdf8e2ccb243d8f5e530.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_6d258db8e7cbfdf8e2ccb243d8f5e530.jpg not downloaded yet
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee48d0910>
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_5bc86c4bbb257ca5119ca8cda6a1c655.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_5bc86c4bbb257ca5119ca8cda6a1c655.jpg saved to cache
2026-03-30 09:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 510537d0-5134-5398-8be1-5ce7f7cfa81f
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1117f10>
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_2da99b7501e55286037b6475cf0d9ffc.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_2da99b7501e55286037b6475cf0d9ffc.jpg saved to cache
2026-03-30 09:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aec91c30-2158-5ba2-9419-38e33eaeefd4
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12d55d0>
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_b5e3b12ce028a0f28b42f9b590e3988f.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_b5e3b12ce028a0f28b42f9b590e3988f.jpg saved to cache
2026-03-30 09:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aec91c30-2158-5ba2-9419-38e33eaeefd4
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1115550>
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_60f83241a6f28006357b718aca3aadb6.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_60f83241a6f28006357b718aca3aadb6.jpg saved to cache
2026-03-30 09:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582
2026-03-30 09:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_63564c305b591675a1c769ac3b4f8db1.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_8f542cd7df98d0f6da0a9dd4a8426d76.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_e98187b5a8ffb76fb9899e764d91a792.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3019aad2-5e58-52c4-9624-01f04959b28d with identifier: EH68061
2026-03-30 09:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3019aad2-5e58-52c4-9624-01f04959b28d with identifier: EH68061
2026-03-30 09:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3019aad2-5e58-52c4-9624-01f04959b28d with identifier: EH68061 to the API
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:08:44Z',
 'fuel_type': 'diesel',
 'id': '3019aad2-5e58-52c4-9624-01f04959b28d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH68061',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 85217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'Mazda CX-3 1.8 Skyactiv-D Evolve',
 'transmission': 'manual',
 'trim': 'Evolve',
 'year': 2019}
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH68061%27 HTTP/1.1" 200 None
2026-03-30 09:10:47 [auto1.it] INFO: Saving data for EH68061: {'auction_closing_time': 1774883324.0, 'created_time': 1774775172.109453, 'last_price_update_time': 1774861847.776421}
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH68061') HTTP/1.1" 204 0
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_a71c158840905ee70d3b590fd51b3a72.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_a71c158840905ee70d3b590fd51b3a72.jpg not downloaded yet
2026-03-30 09:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:47 [auto1.it] INFO: Found listing with ID: MP71804
2026-03-30 09:10:47 [auto1.it] INFO: Found listing with ID: HG08140
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG08140%27 HTTP/1.1" 200 None
2026-03-30 09:10:47 [auto1.it] INFO: Scrape type for HG08140: 2
2026-03-30 09:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2714df41-cdbc-5ccc-8873-c8c801b39f5f with identifier: HG08140
2026-03-30 09:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2714df41-cdbc-5ccc-8873-c8c801b39f5f with scrape type 2
2026-03-30 09:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2714df41-cdbc-5ccc-8873-c8c801b39f5f with scrape type 2
2026-03-30 09:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2714df41-cdbc-5ccc-8873-c8c801b39f5f, identifier: HG08140
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_d43f9ab16999e185406eeedf81f654b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_d43f9ab16999e185406eeedf81f654b3.jpg not downloaded yet
2026-03-30 09:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee27fdf50>
2026-03-30 09:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_27f15a7a08145a3f2f4e0a55d6d80845.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_27f15a7a08145a3f2f4e0a55d6d80845.jpg saved to cache
2026-03-30 09:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aec91c30-2158-5ba2-9419-38e33eaeefd4
2026-03-30 09:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_89fff3ebaebdd84c6d82084545819dd3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_812444c7bedb5fe5d275b065668bd1b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2714df41-cdbc-5ccc-8873-c8c801b39f5f with identifier: HG08140
2026-03-30 09:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2714df41-cdbc-5ccc-8873-c8c801b39f5f with identifier: HG08140
2026-03-30 09:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2714df41-cdbc-5ccc-8873-c8c801b39f5f with identifier: HG08140 to the API
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:55:34Z',
 'fuel_type': 'petrol',
 'id': '2714df41-cdbc-5ccc-8873-c8c801b39f5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG08140',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 25718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-21',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG08140%27 HTTP/1.1" 200 None
2026-03-30 09:10:48 [auto1.it] INFO: Saving data for HG08140: {'auction_closing_time': 1774886134.0, 'created_time': 1774775141.357361, 'last_price_update_time': 1774861848.714033}
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG08140') HTTP/1.1" 204 0
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_5f22e468665d2f1ed4c7ef3f3a8797e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_5f22e468665d2f1ed4c7ef3f3a8797e6.jpg not downloaded yet
2026-03-30 09:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1152ad0>
2026-03-30 09:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_920563f4b5041eb2b82e2e91030583db.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_920563f4b5041eb2b82e2e91030583db.jpg saved to cache
2026-03-30 09:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aec91c30-2158-5ba2-9419-38e33eaeefd4
2026-03-30 09:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2746b90>
2026-03-30 09:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_704bc7802ee63b9456be5aa0db0047f4.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_704bc7802ee63b9456be5aa0db0047f4.jpg saved to cache
2026-03-30 09:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf6f6848-44e0-51c1-b028-2efa867b935c
2026-03-30 09:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_1670ad55bbf26f847cf809b3eac8290f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:48 [auto1.it] INFO: Found listing with ID: EC56092
2026-03-30 09:10:48 [auto1.it] INFO: Found listing with ID: UL24997
2026-03-30 09:10:48 [auto1.it] INFO: Found listing with ID: DF56056
2026-03-30 09:10:48 [auto1.it] INFO: Found listing with ID: BA50531
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA50531%27 HTTP/1.1" 200 None
2026-03-30 09:10:48 [auto1.it] INFO: Scrape type for BA50531: 2
2026-03-30 09:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73798f59-578d-5667-8794-8d4d8faf64dd with identifier: BA50531
2026-03-30 09:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73798f59-578d-5667-8794-8d4d8faf64dd with scrape type 2
2026-03-30 09:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73798f59-578d-5667-8794-8d4d8faf64dd with scrape type 2
2026-03-30 09:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73798f59-578d-5667-8794-8d4d8faf64dd, identifier: BA50531
2026-03-30 09:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY71538/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV93749> (referer: https://www.auto1.com/v1/car-details-view/WV93749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM78375/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_3ec1e36216fb23a790c146049e5506a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_d2d7910f3982abb9508be4422aa113b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73798f59-578d-5667-8794-8d4d8faf64dd with identifier: BA50531
2026-03-30 09:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73798f59-578d-5667-8794-8d4d8faf64dd with identifier: BA50531
2026-03-30 09:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73798f59-578d-5667-8794-8d4d8faf64dd with identifier: BA50531 to the API
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:01Z',
 'fuel_type': 'diesel',
 'id': '73798f59-578d-5667-8794-8d4d8faf64dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA50531',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 126632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Evolve 4WD',
 'transmission': 'automatic',
 'trim': 'Evolve 4WD',
 'year': 2016}
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA50531%27 HTTP/1.1" 200 None
2026-03-30 09:10:49 [auto1.it] INFO: Saving data for BA50531: {'auction_closing_time': 1774885741.0, 'created_time': 1773500758.142705, 'last_price_update_time': 1774861849.467383}
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BA50531') HTTP/1.1" 204 0
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_81e8b33258bf343f04b7a3794d734232.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_81e8b33258bf343f04b7a3794d734232.jpg not downloaded yet
2026-03-30 09:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10d2610>
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_63564c305b591675a1c769ac3b4f8db1.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_63564c305b591675a1c769ac3b4f8db1.jpg saved to cache
2026-03-30 09:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 510537d0-5134-5398-8be1-5ce7f7cfa81f
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10b90d0>
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F70%252F1770d932b782f53f88eb89696c2a3684%252Fpa%252FHW75415_8f542cd7df98d0f6da0a9dd4a8426d76.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_8f542cd7df98d0f6da0a9dd4a8426d76.jpg saved to cache
2026-03-30 09:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85
2026-03-30 09:10:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3bedc3cb-6301-56d7-9e4a-6d805fe99e85, skipping ID generation
2026-03-30 09:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85 with scrape type 1
2026-03-30 09:10:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3bedc3cb-6301-56d7-9e4a-6d805fe99e85 sending to next pipeline
2026-03-30 09:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3bedc3cb-6301-56d7-9e4a-6d805fe99e85, identifier: HW75415
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1314190>
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_e98187b5a8ffb76fb9899e764d91a792.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_e98187b5a8ffb76fb9899e764d91a792.jpg saved to cache
2026-03-30 09:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 510537d0-5134-5398-8be1-5ce7f7cfa81f
2026-03-30 09:10:49 [auto1.it] INFO: Channel: 24h | Page: 23 | totalHits: 3310 | hits on page: 40
2026-03-30 09:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_e5841de4a9133c58d7922d083604e54e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:49 [auto1.it] INFO: Found listing with ID: PV65475
2026-03-30 09:10:49 [auto1.it] INFO: Found listing with ID: RG96871
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG96871%27 HTTP/1.1" 200 None
2026-03-30 09:10:49 [auto1.it] INFO: Scrape type for RG96871: 2
2026-03-30 09:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bff69cf1-3141-597a-8174-0156d005b91c with identifier: RG96871
2026-03-30 09:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bff69cf1-3141-597a-8174-0156d005b91c with scrape type 2
2026-03-30 09:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bff69cf1-3141-597a-8174-0156d005b91c with scrape type 2
2026-03-30 09:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bff69cf1-3141-597a-8174-0156d005b91c, identifier: RG96871
2026-03-30 09:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3bedc3cb-6301-56d7-9e4a-6d805fe99e85 with identifier: HW75415
2026-03-30 09:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3bedc3cb-6301-56d7-9e4a-6d805fe99e85 with identifier: HW75415
2026-03-30 09:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3bedc3cb-6301-56d7-9e4a-6d805fe99e85 with identifier: HW75415 to the API
2026-03-30 09:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_8f542cd7df98d0f6da0a9dd4a8426d76.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:10:23Z',
 'fuel_type': 'hybrid',
 'id': '3bedc3cb-6301-56d7-9e4a-6d805fe99e85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW75415',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 81732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_b39a9a409f4a8d453937db7955411c32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_8f542cd7df98d0f6da0a9dd4a8426d76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_61f9917f9702cfa42947053ae4de80e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_655020a324534d0be49f4122ec47576d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_78967709b75c0c2f71daedb82552ddf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_c3aa9e193433e4d0d15239132121bf1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_a7184153e064079544f8520ce96091a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_5e24f94730f1c3815e6d19ee6ed5b0db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_3f85f42d383544f70529f7ce2b5c13bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3bedc3cb-6301-56d7-9e4a-6d805fe99e85/3bedc3cb-6301-56d7-9e4a-6d805fe99e85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/70/1770d932b782f53f88eb89696c2a3684/pa/HW75415_eb54232586bc0eeacf8c29ef2449ca4d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid XLine 2WD',
 'transmission': 'automatic',
 'trim': 'XLine 2WD',
 'year': 2021}
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW75415%27 HTTP/1.1" 200 None
2026-03-30 09:10:50 [auto1.it] INFO: Saving data for HW75415: {'created_time': 1774861850.564253, 'last_price_update_time': 1774861850.564265, 'auction_closing_time': 1774969823.0}
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW75415') HTTP/1.1" 204 0
2026-03-30 09:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_31a608055aa2230aa7bec5f6afe64adc.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bff69cf1-3141-597a-8174-0156d005b91c with identifier: RG96871
2026-03-30 09:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bff69cf1-3141-597a-8174-0156d005b91c with identifier: RG96871
2026-03-30 09:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bff69cf1-3141-597a-8174-0156d005b91c with identifier: RG96871 to the API
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:31:02Z',
 'fuel_type': 'petrol',
 'id': 'bff69cf1-3141-597a-8174-0156d005b91c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG96871',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 167421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-03',
 'seller_name': None,
 'title': 'Mazda 2 1.3 Independence',
 'transmission': 'manual',
 'trim': 'Independence',
 'year': 2008}
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG96871%27 HTTP/1.1" 200 None
2026-03-30 09:10:50 [auto1.it] INFO: Saving data for RG96871: {'auction_closing_time': 1774884662.0, 'created_time': 1774559431.420196, 'last_price_update_time': 1774861850.889706}
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG96871') HTTP/1.1" 204 0
2026-03-30 09:10:50 [auto1.it] INFO: Found listing with ID: FT31182
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT31182%27 HTTP/1.1" 200 None
2026-03-30 09:10:50 [auto1.it] INFO: Scrape type for FT31182: 2
2026-03-30 09:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af138eb9-634a-5016-9b30-c1eeb136743a with identifier: FT31182
2026-03-30 09:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af138eb9-634a-5016-9b30-c1eeb136743a with scrape type 2
2026-03-30 09:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af138eb9-634a-5016-9b30-c1eeb136743a with scrape type 2
2026-03-30 09:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af138eb9-634a-5016-9b30-c1eeb136743a, identifier: FT31182
2026-03-30 09:10:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee10b9110>
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_89fff3ebaebdd84c6d82084545819dd3.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_89fff3ebaebdd84c6d82084545819dd3.jpg saved to cache
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aec91c30-2158-5ba2-9419-38e33eaeefd4
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24f8090>
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_812444c7bedb5fe5d275b065668bd1b9.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_812444c7bedb5fe5d275b065668bd1b9.jpg saved to cache
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 510537d0-5134-5398-8be1-5ce7f7cfa81f
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee25b85d0>
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_1670ad55bbf26f847cf809b3eac8290f.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_1670ad55bbf26f847cf809b3eac8290f.jpg saved to cache
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aec91c30-2158-5ba2-9419-38e33eaeefd4
2026-03-30 09:10:51 [auto1.it] INFO: Found listing with ID: SJ73545
2026-03-30 09:10:51 [auto1.it] INFO: Found listing with ID: BF99342
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF99342%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [auto1.it] INFO: Scrape type for BF99342: 2
2026-03-30 09:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b8761b1-68e9-5ce8-9188-b30ee85cb2f3 with identifier: BF99342
2026-03-30 09:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b8761b1-68e9-5ce8-9188-b30ee85cb2f3 with scrape type 2
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b8761b1-68e9-5ce8-9188-b30ee85cb2f3 with scrape type 2
2026-03-30 09:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b8761b1-68e9-5ce8-9188-b30ee85cb2f3, identifier: BF99342
2026-03-30 09:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af138eb9-634a-5016-9b30-c1eeb136743a with identifier: FT31182
2026-03-30 09:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af138eb9-634a-5016-9b30-c1eeb136743a with identifier: FT31182
2026-03-30 09:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af138eb9-634a-5016-9b30-c1eeb136743a with identifier: FT31182 to the API
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:55:51Z',
 'fuel_type': 'diesel',
 'id': 'af138eb9-634a-5016-9b30-c1eeb136743a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT31182',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 147048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-22',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport D180 Mild-Hybrid R-Dynamic S AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S AWD',
 'year': 2019}
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT31182%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [auto1.it] INFO: Saving data for FT31182: {'auction_closing_time': 1774886151.0, 'created_time': 1774775146.0955229, 'last_price_update_time': 1774861851.596745}
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT31182') HTTP/1.1" 204 0
2026-03-30 09:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c00fc156-3ae0-53ec-9ffa-96b8971a1c2d with identifier: WV93749
2026-03-30 09:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c00fc156-3ae0-53ec-9ffa-96b8971a1c2d with scrape type 1
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c00fc156-3ae0-53ec-9ffa-96b8971a1c2d
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F47%252F4f474ad6a4e2ac612967c69490bbe2eb%252Fpa%252FWV93749_f7e1c61238a8b08499d28d234885bd18.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_f7e1c61238a8b08499d28d234885bd18.jpg already downloaded
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F47%252F4f474ad6a4e2ac612967c69490bbe2eb%252Fpa%252FWV93749_9ed05448e8d3896f1578b1e06a65bb26.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_9ed05448e8d3896f1578b1e06a65bb26.jpg already downloaded
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F47%252F4f474ad6a4e2ac612967c69490bbe2eb%252Fpa%252FWV93749_9ff6b35758079b53f0dbcb12bdb25109.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_9ff6b35758079b53f0dbcb12bdb25109.jpg already downloaded
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F47%252F4f474ad6a4e2ac612967c69490bbe2eb%252Fpa%252FWV93749_a4023087634c7f669053085a8a860e6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_a4023087634c7f669053085a8a860e6a.jpg already downloaded
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F47%252F4f474ad6a4e2ac612967c69490bbe2eb%252Fpa%252FWV93749_5452734bdb8cee808cf088ece36d88f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_5452734bdb8cee808cf088ece36d88f1.jpg already downloaded
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F47%252F4f474ad6a4e2ac612967c69490bbe2eb%252Fpa%252FWV93749_672a3a0e36bb80bb9fef75b7d45495bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_672a3a0e36bb80bb9fef75b7d45495bd.jpg already downloaded
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F47%252F4f474ad6a4e2ac612967c69490bbe2eb%252Fpa%252FWV93749_bd5401a88cff1448cc2d38393613d7db.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_bd5401a88cff1448cc2d38393613d7db.jpg already downloaded
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F47%252F4f474ad6a4e2ac612967c69490bbe2eb%252Fpa%252FWV93749_3717211009f0548ae03f6def2eb3a83c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_3717211009f0548ae03f6def2eb3a83c.jpg already downloaded
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F47%252F4f474ad6a4e2ac612967c69490bbe2eb%252Fpa%252FWV93749_15753e73d133048cecf112b839b1dd54.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_15753e73d133048cecf112b839b1dd54.jpg already downloaded
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F47%252F4f474ad6a4e2ac612967c69490bbe2eb%252Fpa%252FWV93749_9812ae99c51f68a46c0b831a78a8aa03.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_9812ae99c51f68a46c0b831a78a8aa03.jpg already downloaded
2026-03-30 09:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c00fc156-3ae0-53ec-9ffa-96b8971a1c2d, identifier: WV93749
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2759610>
2026-03-30 09:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_3ec1e36216fb23a790c146049e5506a0.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_3ec1e36216fb23a790c146049e5506a0.jpg saved to cache
2026-03-30 09:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aec91c30-2158-5ba2-9419-38e33eaeefd4
2026-03-30 09:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26ba410>
2026-03-30 09:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_d2d7910f3982abb9508be4422aa113b0.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_d2d7910f3982abb9508be4422aa113b0.jpg saved to cache
2026-03-30 09:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 510537d0-5134-5398-8be1-5ce7f7cfa81f
2026-03-30 09:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_d43f9ab16999e185406eeedf81f654b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_a71c158840905ee70d3b590fd51b3a72.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_6d258db8e7cbfdf8e2ccb243d8f5e530.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b8761b1-68e9-5ce8-9188-b30ee85cb2f3 with identifier: BF99342
2026-03-30 09:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b8761b1-68e9-5ce8-9188-b30ee85cb2f3 with identifier: BF99342
2026-03-30 09:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b8761b1-68e9-5ce8-9188-b30ee85cb2f3 with identifier: BF99342 to the API
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:25:09Z',
 'fuel_type': 'petrol',
 'id': '6b8761b1-68e9-5ce8-9188-b30ee85cb2f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF99342',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 104873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-29',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF99342%27 HTTP/1.1" 200 None
2026-03-30 09:10:52 [auto1.it] INFO: Saving data for BF99342: {'auction_closing_time': 1774884309.0, 'created_time': 1774775139.783579, 'last_price_update_time': 1774861852.406195}
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BF99342') HTTP/1.1" 204 0
2026-03-30 09:10:52 [auto1.it] INFO: Found listing with ID: ET06239
2026-03-30 09:10:52 [auto1.it] INFO: Found listing with ID: MF53034
2026-03-30 09:10:52 [auto1.it] INFO: Found listing with ID: SV79819
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV79819%27 HTTP/1.1" 200 None
2026-03-30 09:10:52 [auto1.it] INFO: Scrape type for SV79819: 2
2026-03-30 09:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1681247-995c-5848-8a0d-0aa7980d9aa1 with identifier: SV79819
2026-03-30 09:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1681247-995c-5848-8a0d-0aa7980d9aa1 with scrape type 2
2026-03-30 09:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1681247-995c-5848-8a0d-0aa7980d9aa1 with scrape type 2
2026-03-30 09:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1681247-995c-5848-8a0d-0aa7980d9aa1, identifier: SV79819
2026-03-30 09:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c00fc156-3ae0-53ec-9ffa-96b8971a1c2d with identifier: WV93749
2026-03-30 09:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c00fc156-3ae0-53ec-9ffa-96b8971a1c2d with identifier: WV93749
2026-03-30 09:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c00fc156-3ae0-53ec-9ffa-96b8971a1c2d with identifier: WV93749 to the API
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WV93749>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:54:03Z',
 'fuel_type': 'petrol',
 'id': 'c00fc156-3ae0-53ec-9ffa-96b8971a1c2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV93749',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 57237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_f7e1c61238a8b08499d28d234885bd18.jpg',
                'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_9ed05448e8d3896f1578b1e06a65bb26.jpg',
                'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_9ff6b35758079b53f0dbcb12bdb25109.jpg',
                'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_a4023087634c7f669053085a8a860e6a.jpg',
                'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_5452734bdb8cee808cf088ece36d88f1.jpg',
                'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_672a3a0e36bb80bb9fef75b7d45495bd.jpg',
                'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_bd5401a88cff1448cc2d38393613d7db.jpg',
                'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_3717211009f0548ae03f6def2eb3a83c.jpg',
                'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_15753e73d133048cecf112b839b1dd54.jpg',
                'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_9812ae99c51f68a46c0b831a78a8aa03.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00fc156-3ae0-53ec-9ffa-96b8971a1c2d/c00fc156-3ae0-53ec-9ffa-96b8971a1c2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_f7e1c61238a8b08499d28d234885bd18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00fc156-3ae0-53ec-9ffa-96b8971a1c2d/c00fc156-3ae0-53ec-9ffa-96b8971a1c2d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_9ed05448e8d3896f1578b1e06a65bb26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00fc156-3ae0-53ec-9ffa-96b8971a1c2d/c00fc156-3ae0-53ec-9ffa-96b8971a1c2d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_9ff6b35758079b53f0dbcb12bdb25109.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00fc156-3ae0-53ec-9ffa-96b8971a1c2d/c00fc156-3ae0-53ec-9ffa-96b8971a1c2d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_a4023087634c7f669053085a8a860e6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00fc156-3ae0-53ec-9ffa-96b8971a1c2d/c00fc156-3ae0-53ec-9ffa-96b8971a1c2d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_5452734bdb8cee808cf088ece36d88f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00fc156-3ae0-53ec-9ffa-96b8971a1c2d/c00fc156-3ae0-53ec-9ffa-96b8971a1c2d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_672a3a0e36bb80bb9fef75b7d45495bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00fc156-3ae0-53ec-9ffa-96b8971a1c2d/c00fc156-3ae0-53ec-9ffa-96b8971a1c2d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_bd5401a88cff1448cc2d38393613d7db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00fc156-3ae0-53ec-9ffa-96b8971a1c2d/c00fc156-3ae0-53ec-9ffa-96b8971a1c2d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_3717211009f0548ae03f6def2eb3a83c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00fc156-3ae0-53ec-9ffa-96b8971a1c2d/c00fc156-3ae0-53ec-9ffa-96b8971a1c2d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_15753e73d133048cecf112b839b1dd54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c00fc156-3ae0-53ec-9ffa-96b8971a1c2d/c00fc156-3ae0-53ec-9ffa-96b8971a1c2d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/47/4f474ad6a4e2ac612967c69490bbe2eb/pa/WV93749_9812ae99c51f68a46c0b831a78a8aa03.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2022}
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV93749%27 HTTP/1.1" 200 None
2026-03-30 09:10:52 [auto1.it] INFO: Saving data for WV93749: {'created_time': 1774861852.941419, 'last_price_update_time': 1774861852.941436, 'auction_closing_time': 1774972443.0}
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WV93749') HTTP/1.1" 204 0
2026-03-30 09:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_f47e2643a2b98b1a95fbb46ea8b765b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_5f22e468665d2f1ed4c7ef3f3a8797e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:52 [auto1.it] INFO: Found listing with ID: FU33041
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU33041%27 HTTP/1.1" 200 None
2026-03-30 09:10:52 [auto1.it] INFO: Scrape type for FU33041: 2
2026-03-30 09:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea1bd963-4c78-56d4-8373-a23f8f49a1e2 with identifier: FU33041
2026-03-30 09:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea1bd963-4c78-56d4-8373-a23f8f49a1e2 with scrape type 2
2026-03-30 09:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea1bd963-4c78-56d4-8373-a23f8f49a1e2 with scrape type 2
2026-03-30 09:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea1bd963-4c78-56d4-8373-a23f8f49a1e2, identifier: FU33041
2026-03-30 09:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1681247-995c-5848-8a0d-0aa7980d9aa1 with identifier: SV79819
2026-03-30 09:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1681247-995c-5848-8a0d-0aa7980d9aa1 with identifier: SV79819
2026-03-30 09:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1681247-995c-5848-8a0d-0aa7980d9aa1 with identifier: SV79819 to the API
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:31:43Z',
 'fuel_type': 'diesel',
 'id': 'f1681247-995c-5848-8a0d-0aa7980d9aa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV79819',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Cordoba',
 'odometer': 136762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-26',
 'seller_name': None,
 'title': 'Seat Cordoba 1.4 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2008}
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV79819%27 HTTP/1.1" 200 None
2026-03-30 09:10:53 [auto1.it] INFO: Saving data for SV79819: {'auction_closing_time': 1774884703.0, 'created_time': 1774559438.799658, 'last_price_update_time': 1774861853.500238}
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SV79819') HTTP/1.1" 204 0
2026-03-30 09:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee108eb10>
2026-03-30 09:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_e5841de4a9133c58d7922d083604e54e.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_e5841de4a9133c58d7922d083604e54e.jpg saved to cache
2026-03-30 09:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 510537d0-5134-5398-8be1-5ce7f7cfa81f
2026-03-30 09:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26ef410>
2026-03-30 09:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_31a608055aa2230aa7bec5f6afe64adc.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_31a608055aa2230aa7bec5f6afe64adc.jpg saved to cache
2026-03-30 09:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf6f6848-44e0-51c1-b028-2efa867b935c
2026-03-30 09:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea1bd963-4c78-56d4-8373-a23f8f49a1e2 with identifier: FU33041
2026-03-30 09:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea1bd963-4c78-56d4-8373-a23f8f49a1e2 with identifier: FU33041
2026-03-30 09:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea1bd963-4c78-56d4-8373-a23f8f49a1e2 with identifier: FU33041 to the API
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 381,
 'expiration_date': '2026-03-30T15:45:32Z',
 'fuel_type': 'hybrid',
 'id': 'ea1bd963-4c78-56d4-8373-a23f8f49a1e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU33041',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 75591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-30',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2022}
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU33041%27 HTTP/1.1" 200 None
2026-03-30 09:10:53 [auto1.it] INFO: Saving data for FU33041: {'auction_closing_time': 1774885532.0, 'created_time': 1774775144.377937, 'last_price_update_time': 1774861853.955777}
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FU33041') HTTP/1.1" 204 0
2026-03-30 09:10:53 [auto1.it] INFO: Found listing with ID: LB26900
2026-03-30 09:10:53 [auto1.it] INFO: Found listing with ID: PS84479
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS84479%27 HTTP/1.1" 200 None
2026-03-30 09:10:53 [auto1.it] INFO: Scrape type for PS84479: 2
2026-03-30 09:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97c8f05e-0de6-5509-aab0-060a264f9e11 with identifier: PS84479
2026-03-30 09:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97c8f05e-0de6-5509-aab0-060a264f9e11 with scrape type 2
2026-03-30 09:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97c8f05e-0de6-5509-aab0-060a264f9e11 with scrape type 2
2026-03-30 09:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97c8f05e-0de6-5509-aab0-060a264f9e11, identifier: PS84479
2026-03-30 09:10:54 [auto1.it] INFO: Found listing with ID: NY98259
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY98259%27 HTTP/1.1" 200 None
2026-03-30 09:10:54 [auto1.it] INFO: Scrape type for NY98259: 2
2026-03-30 09:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d4442ae-97c2-5bd5-bca1-0a3065f3ae3d with identifier: NY98259
2026-03-30 09:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d4442ae-97c2-5bd5-bca1-0a3065f3ae3d with scrape type 2
2026-03-30 09:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d4442ae-97c2-5bd5-bca1-0a3065f3ae3d with scrape type 2
2026-03-30 09:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d4442ae-97c2-5bd5-bca1-0a3065f3ae3d, identifier: NY98259
2026-03-30 09:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97c8f05e-0de6-5509-aab0-060a264f9e11 with identifier: PS84479
2026-03-30 09:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97c8f05e-0de6-5509-aab0-060a264f9e11 with identifier: PS84479
2026-03-30 09:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97c8f05e-0de6-5509-aab0-060a264f9e11 with identifier: PS84479 to the API
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:50:13Z',
 'fuel_type': 'diesel',
 'id': '97c8f05e-0de6-5509-aab0-060a264f9e11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS84479',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 185899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-15',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2019}
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS84479%27 HTTP/1.1" 200 None
2026-03-30 09:10:54 [auto1.it] INFO: Saving data for PS84479: {'auction_closing_time': 1774885813.0, 'created_time': 1774775179.200969, 'last_price_update_time': 1774861854.490889}
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PS84479') HTTP/1.1" 204 0
2026-03-30 09:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN40589> (referer: https://www.auto1.com/v1/car-details-view/GN40589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d4442ae-97c2-5bd5-bca1-0a3065f3ae3d with identifier: NY98259
2026-03-30 09:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d4442ae-97c2-5bd5-bca1-0a3065f3ae3d with identifier: NY98259
2026-03-30 09:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d4442ae-97c2-5bd5-bca1-0a3065f3ae3d with identifier: NY98259 to the API
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:13:49Z',
 'fuel_type': 'diesel',
 'id': '9d4442ae-97c2-5bd5-bca1-0a3065f3ae3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY98259',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 108092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-27',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 R-Dynamic S AWD',
 'transmission': 'manual',
 'trim': 'R-Dynamic S AWD',
 'year': 2019}
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY98259%27 HTTP/1.1" 200 None
2026-03-30 09:10:54 [auto1.it] INFO: Saving data for NY98259: {'auction_closing_time': 1774883629.0, 'created_time': 1774775144.707968, 'last_price_update_time': 1774861854.779125}
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NY98259') HTTP/1.1" 204 0
2026-03-30 09:10:54 [auto1.it] INFO: Found listing with ID: AK50840
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK50840%27 HTTP/1.1" 200 None
2026-03-30 09:10:54 [auto1.it] INFO: Scrape type for AK50840: 2
2026-03-30 09:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7fe4ff-256b-569a-8bc1-0dc962680470 with identifier: AK50840
2026-03-30 09:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7fe4ff-256b-569a-8bc1-0dc962680470 with scrape type 2
2026-03-30 09:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7fe4ff-256b-569a-8bc1-0dc962680470 with scrape type 2
2026-03-30 09:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f7fe4ff-256b-569a-8bc1-0dc962680470, identifier: AK50840
2026-03-30 09:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee261c950>
2026-03-30 09:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_d43f9ab16999e185406eeedf81f654b3.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_d43f9ab16999e185406eeedf81f654b3.jpg saved to cache
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aec91c30-2158-5ba2-9419-38e33eaeefd4
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26f28d0>
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_a71c158840905ee70d3b590fd51b3a72.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_a71c158840905ee70d3b590fd51b3a72.jpg saved to cache
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 510537d0-5134-5398-8be1-5ce7f7cfa81f
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1427390>
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F10%252Fe41004746306168b55f8491ba24602aa%252Fpa%252FAP46989_6d258db8e7cbfdf8e2ccb243d8f5e530.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_6d258db8e7cbfdf8e2ccb243d8f5e530.jpg saved to cache
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aec91c30-2158-5ba2-9419-38e33eaeefd4
2026-03-30 09:10:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aec91c30-2158-5ba2-9419-38e33eaeefd4, skipping ID generation
2026-03-30 09:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec91c30-2158-5ba2-9419-38e33eaeefd4 with scrape type 1
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aec91c30-2158-5ba2-9419-38e33eaeefd4 sending to next pipeline
2026-03-30 09:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aec91c30-2158-5ba2-9419-38e33eaeefd4, identifier: AP46989
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2726b90>
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_f47e2643a2b98b1a95fbb46ea8b765b3.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_f47e2643a2b98b1a95fbb46ea8b765b3.jpg saved to cache
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf6f6848-44e0-51c1-b028-2efa867b935c
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee108ebd0>
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_5f22e468665d2f1ed4c7ef3f3a8797e6.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_5f22e468665d2f1ed4c7ef3f3a8797e6.jpg saved to cache
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 510537d0-5134-5398-8be1-5ce7f7cfa81f
2026-03-30 09:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_81e8b33258bf343f04b7a3794d734232.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_4186c0696d75c1e42fb3d4917f77a08b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:55 [auto1.it] INFO: Found listing with ID: WR25363
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR25363%27 HTTP/1.1" 200 None
2026-03-30 09:10:55 [auto1.it] INFO: Scrape type for WR25363: 2
2026-03-30 09:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ccf2736-24b2-52d7-b612-8591fba14909 with identifier: WR25363
2026-03-30 09:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ccf2736-24b2-52d7-b612-8591fba14909 with scrape type 2
2026-03-30 09:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ccf2736-24b2-52d7-b612-8591fba14909 with scrape type 2
2026-03-30 09:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1ccf2736-24b2-52d7-b612-8591fba14909, identifier: WR25363
2026-03-30 09:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f7fe4ff-256b-569a-8bc1-0dc962680470 with identifier: AK50840
2026-03-30 09:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f7fe4ff-256b-569a-8bc1-0dc962680470 with identifier: AK50840
2026-03-30 09:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f7fe4ff-256b-569a-8bc1-0dc962680470 with identifier: AK50840 to the API
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:38:47Z',
 'fuel_type': 'petrol',
 'id': '7f7fe4ff-256b-569a-8bc1-0dc962680470',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK50840',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Lancia Y',
 'odometer': 80863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-12-27',
 'seller_name': None,
 'title': 'Lancia Lancia Y 1.2 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2001}
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK50840%27 HTTP/1.1" 200 None
2026-03-30 09:10:56 [auto1.it] INFO: Saving data for AK50840: {'auction_closing_time': 1774885127.0, 'created_time': 1774559474.836574, 'last_price_update_time': 1774861856.055825}
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AK50840') HTTP/1.1" 204 0
2026-03-30 09:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aec91c30-2158-5ba2-9419-38e33eaeefd4 with identifier: AP46989
2026-03-30 09:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aec91c30-2158-5ba2-9419-38e33eaeefd4 with identifier: AP46989
2026-03-30 09:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aec91c30-2158-5ba2-9419-38e33eaeefd4 with identifier: AP46989 to the API
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_6d258db8e7cbfdf8e2ccb243d8f5e530.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:17:15Z',
 'fuel_type': 'diesel',
 'id': 'aec91c30-2158-5ba2-9419-38e33eaeefd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP46989',
 'listing': 'auction',
 'location': 'IT, Villasanta',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 409023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_55389d073236f3ec3f883431196ad770.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_2da99b7501e55286037b6475cf0d9ffc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_b5e3b12ce028a0f28b42f9b590e3988f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_27f15a7a08145a3f2f4e0a55d6d80845.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_920563f4b5041eb2b82e2e91030583db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_89fff3ebaebdd84c6d82084545819dd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_1670ad55bbf26f847cf809b3eac8290f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_3ec1e36216fb23a790c146049e5506a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_6d258db8e7cbfdf8e2ccb243d8f5e530.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec91c30-2158-5ba2-9419-38e33eaeefd4/aec91c30-2158-5ba2-9419-38e33eaeefd4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/10/e41004746306168b55f8491ba24602aa/pa/AP46989_d43f9ab16999e185406eeedf81f654b3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP46989%27 HTTP/1.1" 200 None
2026-03-30 09:10:56 [auto1.it] INFO: Saving data for AP46989: {'created_time': 1774861856.441291, 'last_price_update_time': 1774861856.4413, 'auction_closing_time': 1774970235.0}
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AP46989') HTTP/1.1" 204 0
2026-03-30 09:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_8a746da684bd277a30ca680d475b1e96.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1ccf2736-24b2-52d7-b612-8591fba14909 with identifier: WR25363
2026-03-30 09:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1ccf2736-24b2-52d7-b612-8591fba14909 with identifier: WR25363
2026-03-30 09:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1ccf2736-24b2-52d7-b612-8591fba14909 with identifier: WR25363 to the API
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-30T15:59:37Z',
 'fuel_type': 'diesel',
 'id': '1ccf2736-24b2-52d7-b612-8591fba14909',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR25363',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 518167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-31',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR25363%27 HTTP/1.1" 200 None
2026-03-30 09:10:56 [auto1.it] INFO: Saving data for WR25363: {'auction_closing_time': 1774886377.0, 'created_time': 1774559513.172355, 'last_price_update_time': 1774861856.748381}
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WR25363') HTTP/1.1" 204 0
2026-03-30 09:10:56 [auto1.it] INFO: Found listing with ID: FR18393
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR18393%27 HTTP/1.1" 200 None
2026-03-30 09:10:56 [auto1.it] INFO: Scrape type for FR18393: 2
2026-03-30 09:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 778b4856-98bd-501b-823c-017bed79202e with identifier: FR18393
2026-03-30 09:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 778b4856-98bd-501b-823c-017bed79202e with scrape type 2
2026-03-30 09:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 778b4856-98bd-501b-823c-017bed79202e with scrape type 2
2026-03-30 09:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 778b4856-98bd-501b-823c-017bed79202e, identifier: FR18393
2026-03-30 09:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA15878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:56 [auto1.it] INFO: Found listing with ID: XE78625
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE78625%27 HTTP/1.1" 200 None
2026-03-30 09:10:56 [auto1.it] INFO: Scrape type for XE78625: 2
2026-03-30 09:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96b62800-d846-5209-ac4c-a520c97cf8cc with identifier: XE78625
2026-03-30 09:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96b62800-d846-5209-ac4c-a520c97cf8cc with scrape type 2
2026-03-30 09:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96b62800-d846-5209-ac4c-a520c97cf8cc with scrape type 2
2026-03-30 09:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 96b62800-d846-5209-ac4c-a520c97cf8cc, identifier: XE78625
2026-03-30 09:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 778b4856-98bd-501b-823c-017bed79202e with identifier: FR18393
2026-03-30 09:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 778b4856-98bd-501b-823c-017bed79202e with identifier: FR18393
2026-03-30 09:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 778b4856-98bd-501b-823c-017bed79202e with identifier: FR18393 to the API
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:59:44Z',
 'fuel_type': 'diesel',
 'id': '778b4856-98bd-501b-823c-017bed79202e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR18393',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 83835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-24',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR18393%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [auto1.it] INFO: Saving data for FR18393: {'auction_closing_time': 1774886384.0, 'created_time': 1774775156.8459, 'last_price_update_time': 1774861857.283843}
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FR18393') HTTP/1.1" 204 0
2026-03-30 09:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH98415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57aef7be-2a29-5499-8024-4f798af47124 with identifier: GN40589
2026-03-30 09:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57aef7be-2a29-5499-8024-4f798af47124 with scrape type 1
2026-03-30 09:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57aef7be-2a29-5499-8024-4f798af47124
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fab%252Fa7ab174553ceae4d07d7a194175a8164%252Fpa%252FGN40589_af9950d8d718d6d43cc688df001f88b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_af9950d8d718d6d43cc688df001f88b2.jpg already downloaded
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fab%252Fa7ab174553ceae4d07d7a194175a8164%252Fpa%252FGN40589_1c8f288647eefd570d5496191108c5c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c8f288647eefd570d5496191108c5c0.jpg already downloaded
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fab%252Fa7ab174553ceae4d07d7a194175a8164%252Fpa%252FGN40589_369daff5904680da45b7cec6d0ae0d88.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_369daff5904680da45b7cec6d0ae0d88.jpg already downloaded
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fab%252Fa7ab174553ceae4d07d7a194175a8164%252Fpa%252FGN40589_78225655c7d28e52474ce7c6b5b70698.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_78225655c7d28e52474ce7c6b5b70698.jpg already downloaded
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fab%252Fa7ab174553ceae4d07d7a194175a8164%252Fpa%252FGN40589_07cde87017c78cef7146aca89b383f6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_07cde87017c78cef7146aca89b383f6f.jpg already downloaded
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fab%252Fa7ab174553ceae4d07d7a194175a8164%252Fpa%252FGN40589_3bc17cfcf72f78a8358b99592e4c0af6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_3bc17cfcf72f78a8358b99592e4c0af6.jpg already downloaded
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fab%252Fa7ab174553ceae4d07d7a194175a8164%252Fpa%252FGN40589_132cf39f33231bbd371c010857f7ab59.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_132cf39f33231bbd371c010857f7ab59.jpg already downloaded
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fab%252Fa7ab174553ceae4d07d7a194175a8164%252Fpa%252FGN40589_8dcb3ff31f8fb7c69654ca9ab2633ef5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_8dcb3ff31f8fb7c69654ca9ab2633ef5.jpg already downloaded
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fab%252Fa7ab174553ceae4d07d7a194175a8164%252Fpa%252FGN40589_c82de676e7d6f570c85e86bfcbf8b1b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_c82de676e7d6f570c85e86bfcbf8b1b8.jpg already downloaded
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fab%252Fa7ab174553ceae4d07d7a194175a8164%252Fpa%252FGN40589_1c9ce5b116bdfce55dd100640b4ba488.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c9ce5b116bdfce55dd100640b4ba488.jpg already downloaded
2026-03-30 09:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57aef7be-2a29-5499-8024-4f798af47124, identifier: GN40589
2026-03-30 09:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 96b62800-d846-5209-ac4c-a520c97cf8cc with identifier: XE78625
2026-03-30 09:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 96b62800-d846-5209-ac4c-a520c97cf8cc with identifier: XE78625
2026-03-30 09:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 96b62800-d846-5209-ac4c-a520c97cf8cc with identifier: XE78625 to the API
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:48Z',
 'fuel_type': 'diesel',
 'id': '96b62800-d846-5209-ac4c-a520c97cf8cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE78625',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 153016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE78625%27 HTTP/1.1" 200 None
2026-03-30 09:10:57 [auto1.it] INFO: Saving data for XE78625: {'auction_closing_time': 1774884228.0, 'created_time': 1773695250.715715, 'last_price_update_time': 1774861857.991904}
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XE78625') HTTP/1.1" 204 0
2026-03-30 09:10:58 [auto1.it] INFO: Found listing with ID: GY48890
2026-03-30 09:10:58 [auto1.it] INFO: Found listing with ID: AV53481
2026-03-30 09:10:58 [auto1.it] INFO: Found listing with ID: PF95783
2026-03-30 09:10:58 [auto1.it] INFO: Found listing with ID: AB57400
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB57400%27 HTTP/1.1" 200 None
2026-03-30 09:10:58 [auto1.it] INFO: Scrape type for AB57400: 2
2026-03-30 09:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cca29d02-fbea-568d-8497-ea9bd04b6336 with identifier: AB57400
2026-03-30 09:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cca29d02-fbea-568d-8497-ea9bd04b6336 with scrape type 2
2026-03-30 09:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cca29d02-fbea-568d-8497-ea9bd04b6336 with scrape type 2
2026-03-30 09:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cca29d02-fbea-568d-8497-ea9bd04b6336, identifier: AB57400
2026-03-30 09:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57aef7be-2a29-5499-8024-4f798af47124 with identifier: GN40589
2026-03-30 09:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57aef7be-2a29-5499-8024-4f798af47124 with identifier: GN40589
2026-03-30 09:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57aef7be-2a29-5499-8024-4f798af47124 with identifier: GN40589 to the API
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN40589>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:50:33Z',
 'fuel_type': 'diesel',
 'id': '57aef7be-2a29-5499-8024-4f798af47124',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN40589',
 'listing': 'auction',
 'location': 'Torino',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 271343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_af9950d8d718d6d43cc688df001f88b2.jpg',
                'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c8f288647eefd570d5496191108c5c0.jpg',
                'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_369daff5904680da45b7cec6d0ae0d88.jpg',
                'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_78225655c7d28e52474ce7c6b5b70698.jpg',
                'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_07cde87017c78cef7146aca89b383f6f.jpg',
                'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_3bc17cfcf72f78a8358b99592e4c0af6.jpg',
                'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_132cf39f33231bbd371c010857f7ab59.jpg',
                'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_8dcb3ff31f8fb7c69654ca9ab2633ef5.jpg',
                'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_c82de676e7d6f570c85e86bfcbf8b1b8.jpg',
                'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c9ce5b116bdfce55dd100640b4ba488.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2869291,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_af9950d8d718d6d43cc688df001f88b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2800839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c8f288647eefd570d5496191108c5c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_369daff5904680da45b7cec6d0ae0d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729160,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_78225655c7d28e52474ce7c6b5b70698.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2869921,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_07cde87017c78cef7146aca89b383f6f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_3bc17cfcf72f78a8358b99592e4c0af6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1850953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_132cf39f33231bbd371c010857f7ab59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2219463,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_8dcb3ff31f8fb7c69654ca9ab2633ef5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_c82de676e7d6f570c85e86bfcbf8b1b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c9ce5b116bdfce55dd100640b4ba488.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.6 TDI Sport BlueMotion',
 'transmission': 'manual',
 'trim': 'Sport BlueMotion',
 'year': 2019}
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN40589%27 HTTP/1.1" 200 None
2026-03-30 09:10:58 [auto1.it] INFO: Saving data for GN40589: {'created_time': 1774861858.464984, 'last_price_update_time': 1774861858.464997, 'auction_closing_time': 1774972233.0}
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GN40589') HTTP/1.1" 204 0
2026-03-30 09:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_fce0fbb76d693bed2c20a245d2e5e619.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_6a5ce464efcff39cac4622695f19cf9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:10:58 [auto1.it] INFO: Found listing with ID: AU72091
2026-03-30 09:10:58 [auto1.it] INFO: Found listing with ID: UZ37395
2026-03-30 09:10:58 [auto1.it] INFO: Found listing with ID: RA61931
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA61931%27 HTTP/1.1" 200 None
2026-03-30 09:10:58 [auto1.it] INFO: Scrape type for RA61931: 2
2026-03-30 09:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56b06fdf-f519-58ab-b588-5d5ade2ffdd1 with identifier: RA61931
2026-03-30 09:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56b06fdf-f519-58ab-b588-5d5ade2ffdd1 with scrape type 2
2026-03-30 09:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56b06fdf-f519-58ab-b588-5d5ade2ffdd1 with scrape type 2
2026-03-30 09:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56b06fdf-f519-58ab-b588-5d5ade2ffdd1, identifier: RA61931
2026-03-30 09:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cca29d02-fbea-568d-8497-ea9bd04b6336 with identifier: AB57400
2026-03-30 09:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cca29d02-fbea-568d-8497-ea9bd04b6336 with identifier: AB57400
2026-03-30 09:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cca29d02-fbea-568d-8497-ea9bd04b6336 with identifier: AB57400 to the API
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:52:01Z',
 'fuel_type': 'petrol',
 'id': 'cca29d02-fbea-568d-8497-ea9bd04b6336',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB57400',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 106515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2019}
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB57400%27 HTTP/1.1" 200 None
2026-03-30 09:10:58 [auto1.it] INFO: Saving data for AB57400: {'auction_closing_time': 1774885921.0, 'created_time': 1774775152.032086, 'last_price_update_time': 1774861858.887027}
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB57400') HTTP/1.1" 204 0
2026-03-30 09:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fff890>
2026-03-30 09:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_81e8b33258bf343f04b7a3794d734232.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_81e8b33258bf343f04b7a3794d734232.jpg saved to cache
2026-03-30 09:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 510537d0-5134-5398-8be1-5ce7f7cfa81f
2026-03-30 09:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1449410>
2026-03-30 09:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F0c%252F3a0c7c16bbd5a4161dbc99035839111a%252Fpa%252FSU50076_4186c0696d75c1e42fb3d4917f77a08b.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_4186c0696d75c1e42fb3d4917f77a08b.jpg saved to cache
2026-03-30 09:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf6f6848-44e0-51c1-b028-2efa867b935c
2026-03-30 09:10:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf6f6848-44e0-51c1-b028-2efa867b935c, skipping ID generation
2026-03-30 09:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf6f6848-44e0-51c1-b028-2efa867b935c with scrape type 1
2026-03-30 09:10:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf6f6848-44e0-51c1-b028-2efa867b935c sending to next pipeline
2026-03-30 09:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf6f6848-44e0-51c1-b028-2efa867b935c, identifier: SU50076
2026-03-30 09:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee459af10>
2026-03-30 09:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fca%252Fedca7f0d6ab6ea496ced99d07406b2a9%252Fpa%252FMJ72891_8a746da684bd277a30ca680d475b1e96.jpg') HTTP/1.1" 204 0
2026-03-30 09:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_8a746da684bd277a30ca680d475b1e96.jpg saved to cache
2026-03-30 09:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bd08bea-f06f-5843-94ae-964f5487c82f
2026-03-30 09:10:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bd08bea-f06f-5843-94ae-964f5487c82f, skipping ID generation
2026-03-30 09:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd08bea-f06f-5843-94ae-964f5487c82f with scrape type 1
2026-03-30 09:10:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bd08bea-f06f-5843-94ae-964f5487c82f sending to next pipeline
2026-03-30 09:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5bd08bea-f06f-5843-94ae-964f5487c82f, identifier: MJ72891
2026-03-30 09:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56b06fdf-f519-58ab-b588-5d5ade2ffdd1 with identifier: RA61931
2026-03-30 09:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56b06fdf-f519-58ab-b588-5d5ade2ffdd1 with identifier: RA61931
2026-03-30 09:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 56b06fdf-f519-58ab-b588-5d5ade2ffdd1 with identifier: RA61931 to the API
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:04:52Z',
 'fuel_type': 'diesel',
 'id': '56b06fdf-f519-58ab-b588-5d5ade2ffdd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA61931',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 112030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-03',
 'seller_name': None,
 'title': 'BMW 2er 214d Active Tourer Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA61931%27 HTTP/1.1" 200 None
2026-03-30 09:10:59 [auto1.it] INFO: Saving data for RA61931: {'auction_closing_time': 1774883092.0, 'created_time': 1774775161.924621, 'last_price_update_time': 1774861859.667013}
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA61931') HTTP/1.1" 204 0
2026-03-30 09:10:59 [auto1.it] INFO: Found listing with ID: GJ41533
2026-03-30 09:10:59 [auto1.it] INFO: Found listing with ID: VX65874
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX65874%27 HTTP/1.1" 200 None
2026-03-30 09:10:59 [auto1.it] INFO: Scrape type for VX65874: 2
2026-03-30 09:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02959e03-febf-58d4-ad84-1d4dd3511ab7 with identifier: VX65874
2026-03-30 09:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02959e03-febf-58d4-ad84-1d4dd3511ab7 with scrape type 2
2026-03-30 09:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02959e03-febf-58d4-ad84-1d4dd3511ab7 with scrape type 2
2026-03-30 09:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 02959e03-febf-58d4-ad84-1d4dd3511ab7, identifier: VX65874
2026-03-30 09:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf6f6848-44e0-51c1-b028-2efa867b935c with identifier: SU50076
2026-03-30 09:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf6f6848-44e0-51c1-b028-2efa867b935c with identifier: SU50076
2026-03-30 09:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf6f6848-44e0-51c1-b028-2efa867b935c with identifier: SU50076 to the API
2026-03-30 09:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_4186c0696d75c1e42fb3d4917f77a08b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:19:38Z',
 'fuel_type': 'diesel',
 'id': 'bf6f6848-44e0-51c1-b028-2efa867b935c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU50076',
 'listing': 'auction',
 'location': 'IT, Corigliano-Rossano',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 276486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_31d56279a07b4f5112b20cf7eb81a75e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_4186c0696d75c1e42fb3d4917f77a08b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_f47e2643a2b98b1a95fbb46ea8b765b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_ec70981e528d94b518e9ba512d7276cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_31a608055aa2230aa7bec5f6afe64adc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_a56388de33b6d7f54c4803517dae345f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_704bc7802ee63b9456be5aa0db0047f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_0cb6a07d92e5e718c6e4cdfad12fd3c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_9aca8a553b45fbcd65c9f303ff242500.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6f6848-44e0-51c1-b028-2efa867b935c/bf6f6848-44e0-51c1-b028-2efa867b935c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/0c/3a0c7c16bbd5a4161dbc99035839111a/pa/SU50076_5d6e606f49c21b74790d4a98102296dc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 35 TDI Mild-Hybrid design',
 'transmission': 'automatic',
 'trim': 'design',
 'year': 2021}
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU50076%27 HTTP/1.1" 200 None
2026-03-30 09:11:00 [auto1.it] INFO: Saving data for SU50076: {'created_time': 1774861860.277822, 'last_price_update_time': 1774861860.277834, 'auction_closing_time': 1774970378.0}
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SU50076') HTTP/1.1" 204 0
2026-03-30 09:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5bd08bea-f06f-5843-94ae-964f5487c82f with identifier: MJ72891
2026-03-30 09:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5bd08bea-f06f-5843-94ae-964f5487c82f with identifier: MJ72891
2026-03-30 09:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5bd08bea-f06f-5843-94ae-964f5487c82f with identifier: MJ72891 to the API
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_8a746da684bd277a30ca680d475b1e96.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:55:02Z',
 'fuel_type': 'diesel',
 'id': '5bd08bea-f06f-5843-94ae-964f5487c82f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ72891',
 'listing': 'auction',
 'location': 'IT, San Giovanni Teatino',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 242558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_ef73a114f8622d828b02bf90530fe2d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_d37640f6fb98cab08be33ca0b4df2aad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_b01ecadac40a7f7a369485c3247dace3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_c415f29afe34d9de9c107f549e5443eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_177f40aebb7feb3f868063ccee2c51d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_8a746da684bd277a30ca680d475b1e96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_785e7a0b50e7f9d07ea014522550f50c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_27f5fec9d2b2504f9c5058dec865e6c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_212976e3e116266e6af6ea15aaee48c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd08bea-f06f-5843-94ae-964f5487c82f/5bd08bea-f06f-5843-94ae-964f5487c82f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/ca/edca7f0d6ab6ea496ced99d07406b2a9/pa/MJ72891_611c25f308ca3ac6cb38bc525f79b6d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ72891%27 HTTP/1.1" 200 None
2026-03-30 09:11:00 [auto1.it] INFO: Saving data for MJ72891: {'created_time': 1774861860.660564, 'last_price_update_time': 1774861860.660575, 'auction_closing_time': 1774972502.0}
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MJ72891') HTTP/1.1" 204 0
2026-03-30 09:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 02959e03-febf-58d4-ad84-1d4dd3511ab7 with identifier: VX65874
2026-03-30 09:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 02959e03-febf-58d4-ad84-1d4dd3511ab7 with identifier: VX65874
2026-03-30 09:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 02959e03-febf-58d4-ad84-1d4dd3511ab7 with identifier: VX65874 to the API
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:43:44Z',
 'fuel_type': 'diesel',
 'id': '02959e03-febf-58d4-ad84-1d4dd3511ab7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX65874',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 303680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-04',
 'seller_name': None,
 'title': 'Ford S-Max 1.8 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2006}
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX65874%27 HTTP/1.1" 200 None
2026-03-30 09:11:00 [auto1.it] INFO: Saving data for VX65874: {'auction_closing_time': 1774885424.0, 'created_time': 1773436398.176237, 'last_price_update_time': 1774861860.956393}
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VX65874') HTTP/1.1" 204 0
2026-03-30 09:11:00 [auto1.it] INFO: Found listing with ID: KC78706
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC78706%27 HTTP/1.1" 200 None
2026-03-30 09:11:01 [auto1.it] INFO: Scrape type for KC78706: 2
2026-03-30 09:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23887468-4976-55d1-ba96-34cf839b3c00 with identifier: KC78706
2026-03-30 09:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23887468-4976-55d1-ba96-34cf839b3c00 with scrape type 2
2026-03-30 09:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23887468-4976-55d1-ba96-34cf839b3c00 with scrape type 2
2026-03-30 09:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 23887468-4976-55d1-ba96-34cf839b3c00, identifier: KC78706
2026-03-30 09:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM78375> (referer: https://www.auto1.com/v1/car-details-view/SM78375/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 23887468-4976-55d1-ba96-34cf839b3c00 with identifier: KC78706
2026-03-30 09:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 23887468-4976-55d1-ba96-34cf839b3c00 with identifier: KC78706
2026-03-30 09:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 23887468-4976-55d1-ba96-34cf839b3c00 with identifier: KC78706 to the API
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:59:13Z',
 'fuel_type': 'diesel',
 'id': '23887468-4976-55d1-ba96-34cf839b3c00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC78706',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 139593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC78706%27 HTTP/1.1" 200 None
2026-03-30 09:11:01 [auto1.it] INFO: Saving data for KC78706: {'auction_closing_time': 1774886353.0, 'created_time': 1774775148.345359, 'last_price_update_time': 1774861861.442888}
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC78706') HTTP/1.1" 204 0
2026-03-30 09:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP88006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT53783/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:01 [auto1.it] INFO: Found listing with ID: EU94181
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU94181%27 HTTP/1.1" 200 None
2026-03-30 09:11:01 [auto1.it] INFO: Scrape type for EU94181: 2
2026-03-30 09:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d74dc3f8-e4db-5012-a2b8-743c6606a954 with identifier: EU94181
2026-03-30 09:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d74dc3f8-e4db-5012-a2b8-743c6606a954 with scrape type 2
2026-03-30 09:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d74dc3f8-e4db-5012-a2b8-743c6606a954 with scrape type 2
2026-03-30 09:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d74dc3f8-e4db-5012-a2b8-743c6606a954, identifier: EU94181
2026-03-30 09:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1382c10>
2026-03-30 09:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_fce0fbb76d693bed2c20a245d2e5e619.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_fce0fbb76d693bed2c20a245d2e5e619.jpg saved to cache
2026-03-30 09:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582
2026-03-30 09:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1478750>
2026-03-30 09:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc42a3c-7472-506c-8304-a10185c92c68/7fc42a3c-7472-506c-8304-a10185c92c68_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F70%252Fe9707b3d13c2c1f89e8122179a889811%252Fpa%252FFK89155_6a5ce464efcff39cac4622695f19cf9e.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_6a5ce464efcff39cac4622695f19cf9e.jpg saved to cache
2026-03-30 09:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fc42a3c-7472-506c-8304-a10185c92c68
2026-03-30 09:11:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fc42a3c-7472-506c-8304-a10185c92c68, skipping ID generation
2026-03-30 09:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc42a3c-7472-506c-8304-a10185c92c68 with scrape type 1
2026-03-30 09:11:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fc42a3c-7472-506c-8304-a10185c92c68 sending to next pipeline
2026-03-30 09:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7fc42a3c-7472-506c-8304-a10185c92c68, identifier: FK89155
2026-03-30 09:11:01 [auto1.it] INFO: Channel: 24h | Page: 24 | totalHits: 3311 | hits on page: 40
2026-03-30 09:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d74dc3f8-e4db-5012-a2b8-743c6606a954 with identifier: EU94181
2026-03-30 09:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d74dc3f8-e4db-5012-a2b8-743c6606a954 with identifier: EU94181
2026-03-30 09:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d74dc3f8-e4db-5012-a2b8-743c6606a954 with identifier: EU94181 to the API
2026-03-30 09:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:44:03Z',
 'fuel_type': 'petrol',
 'id': 'd74dc3f8-e4db-5012-a2b8-743c6606a954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU94181',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 155792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-17',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU94181%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [auto1.it] INFO: Saving data for EU94181: {'auction_closing_time': 1774885443.0, 'created_time': 1774645790.959124, 'last_price_update_time': 1774861862.123147}
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU94181') HTTP/1.1" 204 0
2026-03-30 09:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7fc42a3c-7472-506c-8304-a10185c92c68 with identifier: FK89155
2026-03-30 09:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7fc42a3c-7472-506c-8304-a10185c92c68 with identifier: FK89155
2026-03-30 09:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7fc42a3c-7472-506c-8304-a10185c92c68 with identifier: FK89155 to the API
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_6a5ce464efcff39cac4622695f19cf9e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 223,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:36:51Z',
 'fuel_type': 'diesel',
 'id': '7fc42a3c-7472-506c-8304-a10185c92c68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK89155',
 'listing': 'auction',
 'location': 'IT, Treviso',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 217060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc42a3c-7472-506c-8304-a10185c92c68/7fc42a3c-7472-506c-8304-a10185c92c68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_5eea605a7ea52221063f5e274713320c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc42a3c-7472-506c-8304-a10185c92c68/7fc42a3c-7472-506c-8304-a10185c92c68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_6a5ce464efcff39cac4622695f19cf9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc42a3c-7472-506c-8304-a10185c92c68/7fc42a3c-7472-506c-8304-a10185c92c68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_da159da289faf39799059ecb04fde9a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc42a3c-7472-506c-8304-a10185c92c68/7fc42a3c-7472-506c-8304-a10185c92c68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_780ef42aa9931550b7d949418e6230f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc42a3c-7472-506c-8304-a10185c92c68/7fc42a3c-7472-506c-8304-a10185c92c68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/70/e9707b3d13c2c1f89e8122179a889811/pa/FK89155_87f7ad5e9f63f33fc8baf94d44d1bf99.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sorento 2.5 CRDi EX',
 'transmission': 'automatic',
 'trim': 'EX',
 'year': 2003}
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK89155%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [auto1.it] INFO: Saving data for FK89155: {'created_time': 1774861862.613509, 'last_price_update_time': 1774861862.613518, 'auction_closing_time': 1774971411.0}
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FK89155') HTTP/1.1" 204 0
2026-03-30 09:11:02 [auto1.it] INFO: Found listing with ID: BJ67581
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ67581%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [auto1.it] INFO: Scrape type for BJ67581: 2
2026-03-30 09:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 713a9b8b-869a-5be9-911e-2efa0183ee51 with identifier: BJ67581
2026-03-30 09:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 713a9b8b-869a-5be9-911e-2efa0183ee51 with scrape type 2
2026-03-30 09:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 713a9b8b-869a-5be9-911e-2efa0183ee51 with scrape type 2
2026-03-30 09:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 713a9b8b-869a-5be9-911e-2efa0183ee51, identifier: BJ67581
2026-03-30 09:11:02 [auto1.it] INFO: Found listing with ID: JT03788
2026-03-30 09:11:02 [auto1.it] INFO: Found listing with ID: AT36089
2026-03-30 09:11:02 [auto1.it] INFO: Found listing with ID: PZ95103
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ95103%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [auto1.it] INFO: Scrape type for PZ95103: 2
2026-03-30 09:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 971f9ce1-73b6-54f8-b2b4-ce6145667042 with identifier: PZ95103
2026-03-30 09:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 971f9ce1-73b6-54f8-b2b4-ce6145667042 with scrape type 2
2026-03-30 09:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 971f9ce1-73b6-54f8-b2b4-ce6145667042 with scrape type 2
2026-03-30 09:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 971f9ce1-73b6-54f8-b2b4-ce6145667042, identifier: PZ95103
2026-03-30 09:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a035539-74f3-53d2-9ec8-1891b15b722d with identifier: SM78375
2026-03-30 09:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a035539-74f3-53d2-9ec8-1891b15b722d with scrape type 1
2026-03-30 09:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a035539-74f3-53d2-9ec8-1891b15b722d
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe6%252F27e6dd247884c6e3be3577fc7ca20f9d%252Fpa%252FSM78375_ff3f1cf108b3389a5fde0f5bfcbc17ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_ff3f1cf108b3389a5fde0f5bfcbc17ea.jpg already downloaded
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe6%252F27e6dd247884c6e3be3577fc7ca20f9d%252Fpa%252FSM78375_e9a1b0d6bb840abcab47617d605517de.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_e9a1b0d6bb840abcab47617d605517de.jpg already downloaded
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe6%252F27e6dd247884c6e3be3577fc7ca20f9d%252Fpa%252FSM78375_4e9fd08196f9f70c75b406d1d1f7750c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_4e9fd08196f9f70c75b406d1d1f7750c.jpg already downloaded
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe6%252F27e6dd247884c6e3be3577fc7ca20f9d%252Fpa%252FSM78375_7ccd931af0e0ebec9ed0ccc3685a8a25.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_7ccd931af0e0ebec9ed0ccc3685a8a25.jpg already downloaded
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe6%252F27e6dd247884c6e3be3577fc7ca20f9d%252Fpa%252FSM78375_b4c7200c854e58ccb8566bd6f84c0e88.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_b4c7200c854e58ccb8566bd6f84c0e88.jpg already downloaded
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe6%252F27e6dd247884c6e3be3577fc7ca20f9d%252Fpa%252FSM78375_c5571c8a0500d51a34ad3a7e70e9442b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_c5571c8a0500d51a34ad3a7e70e9442b.jpg already downloaded
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe6%252F27e6dd247884c6e3be3577fc7ca20f9d%252Fpa%252FSM78375_074c45e520acec6b4f0eccf040ddb1af.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_074c45e520acec6b4f0eccf040ddb1af.jpg already downloaded
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe6%252F27e6dd247884c6e3be3577fc7ca20f9d%252Fpa%252FSM78375_592052966ca885cad23b003ddee40115.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_592052966ca885cad23b003ddee40115.jpg already downloaded
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe6%252F27e6dd247884c6e3be3577fc7ca20f9d%252Fpa%252FSM78375_6178e282eff79b3677e615b79a860aa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_6178e282eff79b3677e615b79a860aa6.jpg already downloaded
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe6%252F27e6dd247884c6e3be3577fc7ca20f9d%252Fpa%252FSM78375_00b99a190dcebc3a13a46f25a5e24782.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_00b99a190dcebc3a13a46f25a5e24782.jpg already downloaded
2026-03-30 09:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5a035539-74f3-53d2-9ec8-1891b15b722d, identifier: SM78375
2026-03-30 09:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 713a9b8b-869a-5be9-911e-2efa0183ee51 with identifier: BJ67581
2026-03-30 09:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 713a9b8b-869a-5be9-911e-2efa0183ee51 with identifier: BJ67581
2026-03-30 09:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 713a9b8b-869a-5be9-911e-2efa0183ee51 with identifier: BJ67581 to the API
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:04:30Z',
 'fuel_type': 'diesel',
 'id': '713a9b8b-869a-5be9-911e-2efa0183ee51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ67581',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 116961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-05',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ67581%27 HTTP/1.1" 200 None
2026-03-30 09:11:03 [auto1.it] INFO: Saving data for BJ67581: {'auction_closing_time': 1774883070.0, 'created_time': 1774775145.752761, 'last_price_update_time': 1774861863.436121}
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ67581') HTTP/1.1" 204 0
2026-03-30 09:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 971f9ce1-73b6-54f8-b2b4-ce6145667042 with identifier: PZ95103
2026-03-30 09:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 971f9ce1-73b6-54f8-b2b4-ce6145667042 with identifier: PZ95103
2026-03-30 09:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 971f9ce1-73b6-54f8-b2b4-ce6145667042 with identifier: PZ95103 to the API
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:15:55Z',
 'fuel_type': 'petrol',
 'id': '971f9ce1-73b6-54f8-b2b4-ce6145667042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ95103',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 56689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2020}
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ95103%27 HTTP/1.1" 200 None
2026-03-30 09:11:03 [auto1.it] INFO: Saving data for PZ95103: {'auction_closing_time': 1774883755.0, 'created_time': 1774775149.042046, 'last_price_update_time': 1774861863.711032}
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ95103') HTTP/1.1" 204 0
2026-03-30 09:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5a035539-74f3-53d2-9ec8-1891b15b722d with identifier: SM78375
2026-03-30 09:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5a035539-74f3-53d2-9ec8-1891b15b722d with identifier: SM78375
2026-03-30 09:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5a035539-74f3-53d2-9ec8-1891b15b722d with identifier: SM78375 to the API
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SM78375>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:44:55Z',
 'fuel_type': 'diesel',
 'id': '5a035539-74f3-53d2-9ec8-1891b15b722d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM78375',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 150904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_ff3f1cf108b3389a5fde0f5bfcbc17ea.jpg',
                'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_e9a1b0d6bb840abcab47617d605517de.jpg',
                'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_4e9fd08196f9f70c75b406d1d1f7750c.jpg',
                'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_7ccd931af0e0ebec9ed0ccc3685a8a25.jpg',
                'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_b4c7200c854e58ccb8566bd6f84c0e88.jpg',
                'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_c5571c8a0500d51a34ad3a7e70e9442b.jpg',
                'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_074c45e520acec6b4f0eccf040ddb1af.jpg',
                'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_592052966ca885cad23b003ddee40115.jpg',
                'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_6178e282eff79b3677e615b79a860aa6.jpg',
                'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_00b99a190dcebc3a13a46f25a5e24782.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a035539-74f3-53d2-9ec8-1891b15b722d/5a035539-74f3-53d2-9ec8-1891b15b722d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_ff3f1cf108b3389a5fde0f5bfcbc17ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a035539-74f3-53d2-9ec8-1891b15b722d/5a035539-74f3-53d2-9ec8-1891b15b722d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2682917,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_e9a1b0d6bb840abcab47617d605517de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a035539-74f3-53d2-9ec8-1891b15b722d/5a035539-74f3-53d2-9ec8-1891b15b722d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_4e9fd08196f9f70c75b406d1d1f7750c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a035539-74f3-53d2-9ec8-1891b15b722d/5a035539-74f3-53d2-9ec8-1891b15b722d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2841500,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_7ccd931af0e0ebec9ed0ccc3685a8a25.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a035539-74f3-53d2-9ec8-1891b15b722d/5a035539-74f3-53d2-9ec8-1891b15b722d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2584778,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_b4c7200c854e58ccb8566bd6f84c0e88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a035539-74f3-53d2-9ec8-1891b15b722d/5a035539-74f3-53d2-9ec8-1891b15b722d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_c5571c8a0500d51a34ad3a7e70e9442b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a035539-74f3-53d2-9ec8-1891b15b722d/5a035539-74f3-53d2-9ec8-1891b15b722d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_074c45e520acec6b4f0eccf040ddb1af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a035539-74f3-53d2-9ec8-1891b15b722d/5a035539-74f3-53d2-9ec8-1891b15b722d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2602352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_592052966ca885cad23b003ddee40115.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a035539-74f3-53d2-9ec8-1891b15b722d/5a035539-74f3-53d2-9ec8-1891b15b722d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_6178e282eff79b3677e615b79a860aa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a035539-74f3-53d2-9ec8-1891b15b722d/5a035539-74f3-53d2-9ec8-1891b15b722d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2866642,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/e6/27e6dd247884c6e3be3577fc7ca20f9d/pa/SM78375_00b99a190dcebc3a13a46f25a5e24782.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM78375%27 HTTP/1.1" 200 None
2026-03-30 09:11:04 [auto1.it] INFO: Saving data for SM78375: {'created_time': 1774861864.105244, 'last_price_update_time': 1774861864.105253, 'auction_closing_time': 1774971895.0}
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SM78375') HTTP/1.1" 204 0
2026-03-30 09:11:04 [auto1.it] INFO: Found listing with ID: AL96330
2026-03-30 09:11:04 [auto1.it] INFO: Found listing with ID: CX70522
2026-03-30 09:11:04 [auto1.it] INFO: Found listing with ID: RN93859
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN93859%27 HTTP/1.1" 200 None
2026-03-30 09:11:04 [auto1.it] INFO: Scrape type for RN93859: 2
2026-03-30 09:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb569eff-ddd2-5ffa-b2bb-e7289999565f with identifier: RN93859
2026-03-30 09:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb569eff-ddd2-5ffa-b2bb-e7289999565f with scrape type 2
2026-03-30 09:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb569eff-ddd2-5ffa-b2bb-e7289999565f with scrape type 2
2026-03-30 09:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb569eff-ddd2-5ffa-b2bb-e7289999565f, identifier: RN93859
2026-03-30 09:11:04 [auto1.it] INFO: Found listing with ID: SR34135
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR34135%27 HTTP/1.1" 200 None
2026-03-30 09:11:04 [auto1.it] INFO: Scrape type for SR34135: 2
2026-03-30 09:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 197b1358-3650-577a-bbac-4eb4ee0fd64a with identifier: SR34135
2026-03-30 09:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 197b1358-3650-577a-bbac-4eb4ee0fd64a with scrape type 2
2026-03-30 09:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 197b1358-3650-577a-bbac-4eb4ee0fd64a with scrape type 2
2026-03-30 09:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 197b1358-3650-577a-bbac-4eb4ee0fd64a, identifier: SR34135
2026-03-30 09:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA52665> (referer: https://www.auto1.com/v1/car-details-view/KA52665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:04 [scrapy.extensions.logstats] INFO: Crawled 269 pages (at 51 pages/min), scraped 445 items (at 88 items/min)
2026-03-30 09:11:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 09:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb569eff-ddd2-5ffa-b2bb-e7289999565f with identifier: RN93859
2026-03-30 09:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb569eff-ddd2-5ffa-b2bb-e7289999565f with identifier: RN93859
2026-03-30 09:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb569eff-ddd2-5ffa-b2bb-e7289999565f with identifier: RN93859 to the API
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:09:26Z',
 'fuel_type': 'diesel',
 'id': 'eb569eff-ddd2-5ffa-b2bb-e7289999565f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN93859',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 225640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-18',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN93859%27 HTTP/1.1" 200 None
2026-03-30 09:11:04 [auto1.it] INFO: Saving data for RN93859: {'auction_closing_time': 1774883366.0, 'created_time': 1774645799.649669, 'last_price_update_time': 1774861864.611531}
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RN93859') HTTP/1.1" 204 0
2026-03-30 09:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 197b1358-3650-577a-bbac-4eb4ee0fd64a with identifier: SR34135
2026-03-30 09:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 197b1358-3650-577a-bbac-4eb4ee0fd64a with identifier: SR34135
2026-03-30 09:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 197b1358-3650-577a-bbac-4eb4ee0fd64a with identifier: SR34135 to the API
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:08:47Z',
 'fuel_type': 'diesel',
 'id': '197b1358-3650-577a-bbac-4eb4ee0fd64a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR34135',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 239490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-11-30',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 270 CDI T Avantgarde',
 'transmission': 'manual',
 'trim': 'T Avantgarde',
 'year': 2003}
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR34135%27 HTTP/1.1" 200 None
2026-03-30 09:11:04 [auto1.it] INFO: Saving data for SR34135: {'auction_closing_time': 1774883327.0, 'created_time': 1773750020.395758, 'last_price_update_time': 1774861864.921204}
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SR34135') HTTP/1.1" 204 0
2026-03-30 09:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_62fd34cd9c75e6f0df4da343e7672f61.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:04 [auto1.it] INFO: Found listing with ID: MG94028
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG94028%27 HTTP/1.1" 200 None
2026-03-30 09:11:04 [auto1.it] INFO: Scrape type for MG94028: 2
2026-03-30 09:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9dfa168-b0b6-58a0-a350-1c95b7992017 with identifier: MG94028
2026-03-30 09:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9dfa168-b0b6-58a0-a350-1c95b7992017 with scrape type 2
2026-03-30 09:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9dfa168-b0b6-58a0-a350-1c95b7992017 with scrape type 2
2026-03-30 09:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9dfa168-b0b6-58a0-a350-1c95b7992017, identifier: MG94028
2026-03-30 09:11:05 [auto1.it] INFO: Found listing with ID: XU47833
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU47833%27 HTTP/1.1" 200 None
2026-03-30 09:11:05 [auto1.it] INFO: Scrape type for XU47833: 2
2026-03-30 09:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c2aa022-3295-57a4-8550-3aa9ed4c3ef5 with identifier: XU47833
2026-03-30 09:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c2aa022-3295-57a4-8550-3aa9ed4c3ef5 with scrape type 2
2026-03-30 09:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c2aa022-3295-57a4-8550-3aa9ed4c3ef5 with scrape type 2
2026-03-30 09:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c2aa022-3295-57a4-8550-3aa9ed4c3ef5, identifier: XU47833
2026-03-30 09:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9dfa168-b0b6-58a0-a350-1c95b7992017 with identifier: MG94028
2026-03-30 09:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9dfa168-b0b6-58a0-a350-1c95b7992017 with identifier: MG94028
2026-03-30 09:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9dfa168-b0b6-58a0-a350-1c95b7992017 with identifier: MG94028 to the API
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:53:31Z',
 'fuel_type': 'diesel',
 'id': 'a9dfa168-b0b6-58a0-a350-1c95b7992017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG94028',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 317745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-28',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG94028%27 HTTP/1.1" 200 None
2026-03-30 09:11:05 [auto1.it] INFO: Saving data for MG94028: {'auction_closing_time': 1774886011.0, 'created_time': 1774645775.175499, 'last_price_update_time': 1774861865.473521}
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MG94028') HTTP/1.1" 204 0
2026-03-30 09:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c2aa022-3295-57a4-8550-3aa9ed4c3ef5 with identifier: XU47833
2026-03-30 09:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c2aa022-3295-57a4-8550-3aa9ed4c3ef5 with identifier: XU47833
2026-03-30 09:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c2aa022-3295-57a4-8550-3aa9ed4c3ef5 with identifier: XU47833 to the API
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:15:02Z',
 'fuel_type': 'diesel',
 'id': '8c2aa022-3295-57a4-8550-3aa9ed4c3ef5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU47833',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 57621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-11',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'automatic',
 'trim': 'Limited FWD',
 'year': 2020}
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU47833%27 HTTP/1.1" 200 None
2026-03-30 09:11:05 [auto1.it] INFO: Saving data for XU47833: {'auction_closing_time': 1774883702.0, 'created_time': 1774775150.620775, 'last_price_update_time': 1774861865.752199}
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XU47833') HTTP/1.1" 204 0
2026-03-30 09:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:05 [auto1.it] INFO: Found listing with ID: ET76297
2026-03-30 09:11:05 [auto1.it] INFO: Found listing with ID: KC92917
2026-03-30 09:11:05 [auto1.it] INFO: Found listing with ID: LT09174
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT09174%27 HTTP/1.1" 200 None
2026-03-30 09:11:05 [auto1.it] INFO: Scrape type for LT09174: 2
2026-03-30 09:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ee73df-7190-5b92-9ea4-7dbf42ddf380 with identifier: LT09174
2026-03-30 09:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ee73df-7190-5b92-9ea4-7dbf42ddf380 with scrape type 2
2026-03-30 09:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62ee73df-7190-5b92-9ea4-7dbf42ddf380 with scrape type 2
2026-03-30 09:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 62ee73df-7190-5b92-9ea4-7dbf42ddf380, identifier: LT09174
2026-03-30 09:11:05 [auto1.it] INFO: Found listing with ID: MH60635
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH60635%27 HTTP/1.1" 200 None
2026-03-30 09:11:05 [auto1.it] INFO: Scrape type for MH60635: 2
2026-03-30 09:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43283f1c-ce0d-5a4f-8216-966218ff17f5 with identifier: MH60635
2026-03-30 09:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43283f1c-ce0d-5a4f-8216-966218ff17f5 with scrape type 2
2026-03-30 09:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43283f1c-ce0d-5a4f-8216-966218ff17f5 with scrape type 2
2026-03-30 09:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 43283f1c-ce0d-5a4f-8216-966218ff17f5, identifier: MH60635
2026-03-30 09:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 62ee73df-7190-5b92-9ea4-7dbf42ddf380 with identifier: LT09174
2026-03-30 09:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 62ee73df-7190-5b92-9ea4-7dbf42ddf380 with identifier: LT09174
2026-03-30 09:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 62ee73df-7190-5b92-9ea4-7dbf42ddf380 with identifier: LT09174 to the API
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:48:01Z',
 'fuel_type': 'petrol',
 'id': '62ee73df-7190-5b92-9ea4-7dbf42ddf380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT09174',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 10148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-19',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2021}
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT09174%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [auto1.it] INFO: Saving data for LT09174: {'auction_closing_time': 1774885681.0, 'created_time': 1774775147.493129, 'last_price_update_time': 1774861866.2666}
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LT09174') HTTP/1.1" 204 0
2026-03-30 09:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 43283f1c-ce0d-5a4f-8216-966218ff17f5 with identifier: MH60635
2026-03-30 09:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 43283f1c-ce0d-5a4f-8216-966218ff17f5 with identifier: MH60635
2026-03-30 09:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 43283f1c-ce0d-5a4f-8216-966218ff17f5 with identifier: MH60635 to the API
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:06:40Z',
 'fuel_type': 'diesel',
 'id': '43283f1c-ce0d-5a4f-8216-966218ff17f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH60635',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 82557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige 4x4',
 'transmission': 'manual',
 'trim': 'Prestige 4x4',
 'year': 2020}
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH60635%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [auto1.it] INFO: Saving data for MH60635: {'auction_closing_time': 1774883200.0, 'created_time': 1774775170.952271, 'last_price_update_time': 1774861866.663683}
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MH60635') HTTP/1.1" 204 0
2026-03-30 09:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c47864b-f87e-55d8-a99b-57c0a42f37cc with identifier: KA52665
2026-03-30 09:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c47864b-f87e-55d8-a99b-57c0a42f37cc with scrape type 1
2026-03-30 09:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c47864b-f87e-55d8-a99b-57c0a42f37cc
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F87%252Fe8876798d35924a2f0c570ba84a6e43d%252Fpa%252FKA52665_6df03baa8815390512ca174dbcb2cdf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_6df03baa8815390512ca174dbcb2cdf7.jpg already downloaded
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F87%252Fe8876798d35924a2f0c570ba84a6e43d%252Fpa%252FKA52665_b3ac57c8c929ae57b9ea1ebd4cbf9999.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_b3ac57c8c929ae57b9ea1ebd4cbf9999.jpg already downloaded
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F87%252Fe8876798d35924a2f0c570ba84a6e43d%252Fpa%252FKA52665_fab01c8d7e639efa74f4820a066aab69.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_fab01c8d7e639efa74f4820a066aab69.jpg already downloaded
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F87%252Fe8876798d35924a2f0c570ba84a6e43d%252Fpa%252FKA52665_f3e55ac322222277755112c527d16be0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_f3e55ac322222277755112c527d16be0.jpg already downloaded
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F87%252Fe8876798d35924a2f0c570ba84a6e43d%252Fpa%252FKA52665_9c0728091ad2d3277d7cc19a6a2a05e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_9c0728091ad2d3277d7cc19a6a2a05e8.jpg already downloaded
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F87%252Fe8876798d35924a2f0c570ba84a6e43d%252Fpa%252FKA52665_4b6e42613ba34c5779b98b14ba1dedc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_4b6e42613ba34c5779b98b14ba1dedc1.jpg already downloaded
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F87%252Fe8876798d35924a2f0c570ba84a6e43d%252Fpa%252FKA52665_ccaeefc79dcccd187bb03bc0b394ea19.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_ccaeefc79dcccd187bb03bc0b394ea19.jpg already downloaded
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F87%252Fe8876798d35924a2f0c570ba84a6e43d%252Fpa%252FKA52665_f6ef088272ba293f6fc54fb63611e874.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_f6ef088272ba293f6fc54fb63611e874.jpg already downloaded
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F87%252Fe8876798d35924a2f0c570ba84a6e43d%252Fpa%252FKA52665_878d161ab615c0d023cfe6a0ba5efe23.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_878d161ab615c0d023cfe6a0ba5efe23.jpg already downloaded
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F87%252Fe8876798d35924a2f0c570ba84a6e43d%252Fpa%252FKA52665_190d7ac3f10d3e67e53c077e07ccc998.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_190d7ac3f10d3e67e53c077e07ccc998.jpg already downloaded
2026-03-30 09:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9c47864b-f87e-55d8-a99b-57c0a42f37cc, identifier: KA52665
2026-03-30 09:11:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2637210>
2026-03-30 09:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F47%252F6147f45dae3d31fe346d5a814bfc638b%252Fpa%252FTT29802_62fd34cd9c75e6f0df4da343e7672f61.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_62fd34cd9c75e6f0df4da343e7672f61.jpg saved to cache
2026-03-30 09:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 510537d0-5134-5398-8be1-5ce7f7cfa81f
2026-03-30 09:11:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 510537d0-5134-5398-8be1-5ce7f7cfa81f, skipping ID generation
2026-03-30 09:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 510537d0-5134-5398-8be1-5ce7f7cfa81f with scrape type 1
2026-03-30 09:11:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 510537d0-5134-5398-8be1-5ce7f7cfa81f sending to next pipeline
2026-03-30 09:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 510537d0-5134-5398-8be1-5ce7f7cfa81f, identifier: TT29802
2026-03-30 09:11:07 [auto1.it] INFO: Found listing with ID: JK70304
2026-03-30 09:11:07 [auto1.it] INFO: Found listing with ID: TT78909
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT78909%27 HTTP/1.1" 200 None
2026-03-30 09:11:07 [auto1.it] INFO: Scrape type for TT78909: 2
2026-03-30 09:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70a6a567-9d3f-5e9a-9587-d496c1a7bf13 with identifier: TT78909
2026-03-30 09:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70a6a567-9d3f-5e9a-9587-d496c1a7bf13 with scrape type 2
2026-03-30 09:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70a6a567-9d3f-5e9a-9587-d496c1a7bf13 with scrape type 2
2026-03-30 09:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 70a6a567-9d3f-5e9a-9587-d496c1a7bf13, identifier: TT78909
2026-03-30 09:11:07 [auto1.it] INFO: Found listing with ID: VB43526
2026-03-30 09:11:07 [auto1.it] INFO: Found listing with ID: ZU21710
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU21710%27 HTTP/1.1" 200 None
2026-03-30 09:11:07 [auto1.it] INFO: Scrape type for ZU21710: 2
2026-03-30 09:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4084fd2-6ea8-53da-8a0b-0d24627c4007 with identifier: ZU21710
2026-03-30 09:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4084fd2-6ea8-53da-8a0b-0d24627c4007 with scrape type 2
2026-03-30 09:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4084fd2-6ea8-53da-8a0b-0d24627c4007 with scrape type 2
2026-03-30 09:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4084fd2-6ea8-53da-8a0b-0d24627c4007, identifier: ZU21710
2026-03-30 09:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY85045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9c47864b-f87e-55d8-a99b-57c0a42f37cc with identifier: KA52665
2026-03-30 09:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9c47864b-f87e-55d8-a99b-57c0a42f37cc with identifier: KA52665
2026-03-30 09:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9c47864b-f87e-55d8-a99b-57c0a42f37cc with identifier: KA52665 to the API
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KA52665>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:00:41Z',
 'fuel_type': 'hybrid',
 'id': '9c47864b-f87e-55d8-a99b-57c0a42f37cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA52665',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'BMW',
 'model': '2er',
 'odometer': 84150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_6df03baa8815390512ca174dbcb2cdf7.jpg',
                'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_b3ac57c8c929ae57b9ea1ebd4cbf9999.jpg',
                'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_fab01c8d7e639efa74f4820a066aab69.jpg',
                'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_f3e55ac322222277755112c527d16be0.jpg',
                'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_9c0728091ad2d3277d7cc19a6a2a05e8.jpg',
                'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_4b6e42613ba34c5779b98b14ba1dedc1.jpg',
                'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_ccaeefc79dcccd187bb03bc0b394ea19.jpg',
                'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_f6ef088272ba293f6fc54fb63611e874.jpg',
                'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_878d161ab615c0d023cfe6a0ba5efe23.jpg',
                'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_190d7ac3f10d3e67e53c077e07ccc998.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47864b-f87e-55d8-a99b-57c0a42f37cc/9c47864b-f87e-55d8-a99b-57c0a42f37cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_6df03baa8815390512ca174dbcb2cdf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47864b-f87e-55d8-a99b-57c0a42f37cc/9c47864b-f87e-55d8-a99b-57c0a42f37cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_b3ac57c8c929ae57b9ea1ebd4cbf9999.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47864b-f87e-55d8-a99b-57c0a42f37cc/9c47864b-f87e-55d8-a99b-57c0a42f37cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_fab01c8d7e639efa74f4820a066aab69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47864b-f87e-55d8-a99b-57c0a42f37cc/9c47864b-f87e-55d8-a99b-57c0a42f37cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_f3e55ac322222277755112c527d16be0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47864b-f87e-55d8-a99b-57c0a42f37cc/9c47864b-f87e-55d8-a99b-57c0a42f37cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_9c0728091ad2d3277d7cc19a6a2a05e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47864b-f87e-55d8-a99b-57c0a42f37cc/9c47864b-f87e-55d8-a99b-57c0a42f37cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_4b6e42613ba34c5779b98b14ba1dedc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47864b-f87e-55d8-a99b-57c0a42f37cc/9c47864b-f87e-55d8-a99b-57c0a42f37cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_ccaeefc79dcccd187bb03bc0b394ea19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47864b-f87e-55d8-a99b-57c0a42f37cc/9c47864b-f87e-55d8-a99b-57c0a42f37cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_f6ef088272ba293f6fc54fb63611e874.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47864b-f87e-55d8-a99b-57c0a42f37cc/9c47864b-f87e-55d8-a99b-57c0a42f37cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_878d161ab615c0d023cfe6a0ba5efe23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47864b-f87e-55d8-a99b-57c0a42f37cc/9c47864b-f87e-55d8-a99b-57c0a42f37cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/87/e8876798d35924a2f0c570ba84a6e43d/pa/KA52665_190d7ac3f10d3e67e53c077e07ccc998.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 225xe Active Tourer Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2017}
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA52665%27 HTTP/1.1" 200 None
2026-03-30 09:11:07 [auto1.it] INFO: Saving data for KA52665: {'created_time': 1774861867.740853, 'last_price_update_time': 1774861867.740864, 'auction_closing_time': 1774969241.0}
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KA52665') HTTP/1.1" 204 0
2026-03-30 09:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 510537d0-5134-5398-8be1-5ce7f7cfa81f with identifier: TT29802
2026-03-30 09:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 510537d0-5134-5398-8be1-5ce7f7cfa81f with identifier: TT29802
2026-03-30 09:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 510537d0-5134-5398-8be1-5ce7f7cfa81f with identifier: TT29802 to the API
2026-03-30 09:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_62fd34cd9c75e6f0df4da343e7672f61.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:32:57Z',
 'fuel_type': 'diesel',
 'id': '510537d0-5134-5398-8be1-5ce7f7cfa81f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT29802',
 'listing': 'auction',
 'location': 'IT, Verona',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 240362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2392756,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_62fd34cd9c75e6f0df4da343e7672f61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_e98187b5a8ffb76fb9899e764d91a792.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_5bc86c4bbb257ca5119ca8cda6a1c655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_812444c7bedb5fe5d275b065668bd1b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_63564c305b591675a1c769ac3b4f8db1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_d2d7910f3982abb9508be4422aa113b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_e5841de4a9133c58d7922d083604e54e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_a71c158840905ee70d3b590fd51b3a72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_5f22e468665d2f1ed4c7ef3f3a8797e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_510537d0-5134-5398-8be1-5ce7f7cfa81f/510537d0-5134-5398-8be1-5ce7f7cfa81f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/47/6147f45dae3d31fe346d5a814bfc638b/pa/TT29802_81e8b33258bf343f04b7a3794d734232.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT29802%27 HTTP/1.1" 200 None
2026-03-30 09:11:08 [auto1.it] INFO: Saving data for TT29802: {'created_time': 1774861868.177259, 'last_price_update_time': 1774861868.177268, 'auction_closing_time': 1774971177.0}
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TT29802') HTTP/1.1" 204 0
2026-03-30 09:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 70a6a567-9d3f-5e9a-9587-d496c1a7bf13 with identifier: TT78909
2026-03-30 09:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 70a6a567-9d3f-5e9a-9587-d496c1a7bf13 with identifier: TT78909
2026-03-30 09:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 70a6a567-9d3f-5e9a-9587-d496c1a7bf13 with identifier: TT78909 to the API
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:40:02Z',
 'fuel_type': 'petrol',
 'id': '70a6a567-9d3f-5e9a-9587-d496c1a7bf13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT78909',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 214355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-05-26',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2004}
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT78909%27 HTTP/1.1" 200 None
2026-03-30 09:11:08 [auto1.it] INFO: Saving data for TT78909: {'auction_closing_time': 1774885202.0, 'created_time': 1774559412.781202, 'last_price_update_time': 1774861868.460694}
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TT78909') HTTP/1.1" 204 0
2026-03-30 09:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4084fd2-6ea8-53da-8a0b-0d24627c4007 with identifier: ZU21710
2026-03-30 09:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4084fd2-6ea8-53da-8a0b-0d24627c4007 with identifier: ZU21710
2026-03-30 09:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4084fd2-6ea8-53da-8a0b-0d24627c4007 with identifier: ZU21710 to the API
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:56:52Z',
 'fuel_type': 'diesel',
 'id': 'b4084fd2-6ea8-53da-8a0b-0d24627c4007',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU21710',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 199572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-14',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU21710%27 HTTP/1.1" 200 None
2026-03-30 09:11:08 [auto1.it] INFO: Saving data for ZU21710: {'auction_closing_time': 1774886212.0, 'created_time': 1774775154.952206, 'last_price_update_time': 1774861868.752547}
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU21710') HTTP/1.1" 204 0
2026-03-30 09:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA15878> (referer: https://www.auto1.com/v1/car-details-view/AA15878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:08 [auto1.it] INFO: Found listing with ID: EH72083
2026-03-30 09:11:08 [auto1.it] INFO: Found listing with ID: YW20970
2026-03-30 09:11:08 [auto1.it] INFO: Found listing with ID: XH54291
2026-03-30 09:11:08 [auto1.it] INFO: Found listing with ID: MT29118
2026-03-30 09:11:08 [auto1.it] INFO: Found listing with ID: DU49636
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU49636%27 HTTP/1.1" 200 None
2026-03-30 09:11:08 [auto1.it] INFO: Scrape type for DU49636: 2
2026-03-30 09:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc0d8e19-8303-5430-a9b1-3d463b65cfcf with identifier: DU49636
2026-03-30 09:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc0d8e19-8303-5430-a9b1-3d463b65cfcf with scrape type 2
2026-03-30 09:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc0d8e19-8303-5430-a9b1-3d463b65cfcf with scrape type 2
2026-03-30 09:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dc0d8e19-8303-5430-a9b1-3d463b65cfcf, identifier: DU49636
2026-03-30 09:11:08 [auto1.it] INFO: Found listing with ID: VU35787
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU35787%27 HTTP/1.1" 200 None
2026-03-30 09:11:08 [auto1.it] INFO: Scrape type for VU35787: 2
2026-03-30 09:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48569f33-6e5f-5141-974d-b8540e4b2ff9 with identifier: VU35787
2026-03-30 09:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48569f33-6e5f-5141-974d-b8540e4b2ff9 with scrape type 2
2026-03-30 09:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48569f33-6e5f-5141-974d-b8540e4b2ff9 with scrape type 2
2026-03-30 09:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 48569f33-6e5f-5141-974d-b8540e4b2ff9, identifier: VU35787
2026-03-30 09:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH98415> (referer: https://www.auto1.com/v1/car-details-view/TH98415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dc0d8e19-8303-5430-a9b1-3d463b65cfcf with identifier: DU49636
2026-03-30 09:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dc0d8e19-8303-5430-a9b1-3d463b65cfcf with identifier: DU49636
2026-03-30 09:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dc0d8e19-8303-5430-a9b1-3d463b65cfcf with identifier: DU49636 to the API
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'petrol',
 'id': 'dc0d8e19-8303-5430-a9b1-3d463b65cfcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU49636',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 161748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-01-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU49636%27 HTTP/1.1" 200 None
2026-03-30 09:11:09 [auto1.it] INFO: Saving data for DU49636: {'auction_closing_time': 1774883052.0, 'created_time': 1774559409.621823, 'last_price_update_time': 1774861869.372275}
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DU49636') HTTP/1.1" 204 0
2026-03-30 09:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 48569f33-6e5f-5141-974d-b8540e4b2ff9 with identifier: VU35787
2026-03-30 09:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 48569f33-6e5f-5141-974d-b8540e4b2ff9 with identifier: VU35787
2026-03-30 09:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 48569f33-6e5f-5141-974d-b8540e4b2ff9 with identifier: VU35787 to the API
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:56:33Z',
 'fuel_type': 'petrol',
 'id': '48569f33-6e5f-5141-974d-b8540e4b2ff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU35787',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Seicento',
 'odometer': 94080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-24',
 'seller_name': None,
 'title': 'Fiat Seicento 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2004}
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU35787%27 HTTP/1.1" 200 None
2026-03-30 09:11:09 [auto1.it] INFO: Saving data for VU35787: {'auction_closing_time': 1774886193.0, 'created_time': 1774645752.357586, 'last_price_update_time': 1774861869.683694}
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VU35787') HTTP/1.1" 204 0
2026-03-30 09:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:09 [auto1.it] INFO: Found listing with ID: GE97185
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE97185%27 HTTP/1.1" 200 None
2026-03-30 09:11:09 [auto1.it] INFO: Scrape type for GE97185: 2
2026-03-30 09:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce99e5d-da0e-5bc9-8552-83545109f415 with identifier: GE97185
2026-03-30 09:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce99e5d-da0e-5bc9-8552-83545109f415 with scrape type 2
2026-03-30 09:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bce99e5d-da0e-5bc9-8552-83545109f415 with scrape type 2
2026-03-30 09:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bce99e5d-da0e-5bc9-8552-83545109f415, identifier: GE97185
2026-03-30 09:11:09 [auto1.it] INFO: Found listing with ID: JE99705
2026-03-30 09:11:09 [auto1.it] INFO: Found listing with ID: FF41288
2026-03-30 09:11:09 [auto1.it] INFO: Found listing with ID: ST04114
2026-03-30 09:11:09 [auto1.it] INFO: Found listing with ID: MX17045
2026-03-30 09:11:09 [auto1.it] INFO: Found listing with ID: VR64645
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR64645%27 HTTP/1.1" 200 None
2026-03-30 09:11:09 [auto1.it] INFO: Scrape type for VR64645: 2
2026-03-30 09:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c071b83e-c439-5c5b-97aa-e34864c559cb with identifier: VR64645
2026-03-30 09:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c071b83e-c439-5c5b-97aa-e34864c559cb with scrape type 2
2026-03-30 09:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c071b83e-c439-5c5b-97aa-e34864c559cb with scrape type 2
2026-03-30 09:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c071b83e-c439-5c5b-97aa-e34864c559cb, identifier: VR64645
2026-03-30 09:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bce99e5d-da0e-5bc9-8552-83545109f415 with identifier: GE97185
2026-03-30 09:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bce99e5d-da0e-5bc9-8552-83545109f415 with identifier: GE97185
2026-03-30 09:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bce99e5d-da0e-5bc9-8552-83545109f415 with identifier: GE97185 to the API
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 209,
 'expiration_date': '2026-03-30T15:07:28Z',
 'fuel_type': 'diesel',
 'id': 'bce99e5d-da0e-5bc9-8552-83545109f415',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE97185',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 112945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-17',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Ti Q4',
 'transmission': 'automatic',
 'trim': 'Ti Q4',
 'year': 2021}
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE97185%27 HTTP/1.1" 200 None
2026-03-30 09:11:10 [auto1.it] INFO: Saving data for GE97185: {'auction_closing_time': 1774883248.0, 'created_time': 1774775153.076129, 'last_price_update_time': 1774861870.207783}
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GE97185') HTTP/1.1" 204 0
2026-03-30 09:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c071b83e-c439-5c5b-97aa-e34864c559cb with identifier: VR64645
2026-03-30 09:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c071b83e-c439-5c5b-97aa-e34864c559cb with identifier: VR64645
2026-03-30 09:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c071b83e-c439-5c5b-97aa-e34864c559cb with identifier: VR64645 to the API
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:55:32Z',
 'fuel_type': 'petrol',
 'id': 'c071b83e-c439-5c5b-97aa-e34864c559cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR64645',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 228069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-25',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.2 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2014}
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR64645%27 HTTP/1.1" 200 None
2026-03-30 09:11:10 [auto1.it] INFO: Saving data for VR64645: {'auction_closing_time': 1774886132.0, 'created_time': 1774559487.837991, 'last_price_update_time': 1774861870.593381}
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VR64645') HTTP/1.1" 204 0
2026-03-30 09:11:10 [auto1.it] INFO: Found listing with ID: TS11869
2026-03-30 09:11:10 [auto1.it] INFO: Found listing with ID: UJ50466
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ50466%27 HTTP/1.1" 200 None
2026-03-30 09:11:10 [auto1.it] INFO: Scrape type for UJ50466: 2
2026-03-30 09:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e528e1-fb1f-5c94-a381-c771993becea with identifier: UJ50466
2026-03-30 09:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e528e1-fb1f-5c94-a381-c771993becea with scrape type 2
2026-03-30 09:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9e528e1-fb1f-5c94-a381-c771993becea with scrape type 2
2026-03-30 09:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c9e528e1-fb1f-5c94-a381-c771993becea, identifier: UJ50466
2026-03-30 09:11:10 [auto1.it] INFO: Found listing with ID: SN43822
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN43822%27 HTTP/1.1" 200 None
2026-03-30 09:11:10 [auto1.it] INFO: Scrape type for SN43822: 2
2026-03-30 09:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a330955f-47a8-5920-a5b3-4c3d2f04c711 with identifier: SN43822
2026-03-30 09:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a330955f-47a8-5920-a5b3-4c3d2f04c711 with scrape type 2
2026-03-30 09:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a330955f-47a8-5920-a5b3-4c3d2f04c711 with scrape type 2
2026-03-30 09:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a330955f-47a8-5920-a5b3-4c3d2f04c711, identifier: SN43822
2026-03-30 09:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c9e528e1-fb1f-5c94-a381-c771993becea with identifier: UJ50466
2026-03-30 09:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c9e528e1-fb1f-5c94-a381-c771993becea with identifier: UJ50466
2026-03-30 09:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c9e528e1-fb1f-5c94-a381-c771993becea with identifier: UJ50466 to the API
2026-03-30 09:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:37Z',
 'fuel_type': 'diesel',
 'id': 'c9e528e1-fb1f-5c94-a381-c771993becea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ50466',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 105042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ50466%27 HTTP/1.1" 200 None
2026-03-30 09:11:12 [auto1.it] INFO: Saving data for UJ50466: {'auction_closing_time': 1774884457.0, 'created_time': 1774775156.161444, 'last_price_update_time': 1774861872.154186}
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UJ50466') HTTP/1.1" 204 0
2026-03-30 09:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a330955f-47a8-5920-a5b3-4c3d2f04c711 with identifier: SN43822
2026-03-30 09:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a330955f-47a8-5920-a5b3-4c3d2f04c711 with identifier: SN43822
2026-03-30 09:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a330955f-47a8-5920-a5b3-4c3d2f04c711 with identifier: SN43822 to the API
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:02:49Z',
 'fuel_type': 'diesel',
 'id': 'a330955f-47a8-5920-a5b3-4c3d2f04c711',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN43822',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 137638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'automatic',
 'trim': 'Limited FWD',
 'year': 2017}
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN43822%27 HTTP/1.1" 200 None
2026-03-30 09:11:12 [auto1.it] INFO: Saving data for SN43822: {'auction_closing_time': 1774882969.0, 'created_time': 1773695396.912786, 'last_price_update_time': 1774861872.432643}
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN43822') HTTP/1.1" 204 0
2026-03-30 09:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with identifier: AA15878
2026-03-30 09:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with scrape type 1
2026-03-30 09:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg not downloaded yet
2026-03-30 09:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c554bb5-b057-521f-b650-242ef5e471bb with identifier: TH98415
2026-03-30 09:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c554bb5-b057-521f-b650-242ef5e471bb with scrape type 1
2026-03-30 09:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c554bb5-b057-521f-b650-242ef5e471bb
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_c3092e96d70cc245e800b26dfe67bd59.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_c3092e96d70cc245e800b26dfe67bd59.jpg not downloaded yet
2026-03-30 09:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:12 [auto1.it] INFO: Channel: 24h | Page: 25 | totalHits: 3311 | hits on page: 40
2026-03-30 09:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_4c69f4a7482985609e11c70d76c53151.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:12 [auto1.it] INFO: Found listing with ID: CM44345
2026-03-30 09:11:12 [auto1.it] INFO: Found listing with ID: DT89224
2026-03-30 09:11:12 [auto1.it] INFO: Found listing with ID: BT02963
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT02963%27 HTTP/1.1" 200 None
2026-03-30 09:11:12 [auto1.it] INFO: Scrape type for BT02963: 2
2026-03-30 09:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39df49a1-632e-5e56-91c1-7f3fafb6d20f with identifier: BT02963
2026-03-30 09:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39df49a1-632e-5e56-91c1-7f3fafb6d20f with scrape type 2
2026-03-30 09:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39df49a1-632e-5e56-91c1-7f3fafb6d20f with scrape type 2
2026-03-30 09:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 39df49a1-632e-5e56-91c1-7f3fafb6d20f, identifier: BT02963
2026-03-30 09:11:12 [auto1.it] INFO: Found listing with ID: SD56970
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD56970%27 HTTP/1.1" 200 None
2026-03-30 09:11:12 [auto1.it] INFO: Scrape type for SD56970: 2
2026-03-30 09:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0129520f-95c4-5782-8c70-d8f9ca8b475f with identifier: SD56970
2026-03-30 09:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0129520f-95c4-5782-8c70-d8f9ca8b475f with scrape type 2
2026-03-30 09:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0129520f-95c4-5782-8c70-d8f9ca8b475f with scrape type 2
2026-03-30 09:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0129520f-95c4-5782-8c70-d8f9ca8b475f, identifier: SD56970
2026-03-30 09:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 39df49a1-632e-5e56-91c1-7f3fafb6d20f with identifier: BT02963
2026-03-30 09:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 39df49a1-632e-5e56-91c1-7f3fafb6d20f with identifier: BT02963
2026-03-30 09:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 39df49a1-632e-5e56-91c1-7f3fafb6d20f with identifier: BT02963 to the API
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:03:50Z',
 'fuel_type': 'diesel',
 'id': '39df49a1-632e-5e56-91c1-7f3fafb6d20f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT02963',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 103337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-22',
 'seller_name': None,
 'title': 'BMW 3er 316d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2016}
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT02963%27 HTTP/1.1" 200 None
2026-03-30 09:11:13 [auto1.it] INFO: Saving data for BT02963: {'auction_closing_time': 1774883030.0, 'created_time': 1774775149.807347, 'last_price_update_time': 1774861873.021454}
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BT02963') HTTP/1.1" 204 0
2026-03-30 09:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0129520f-95c4-5782-8c70-d8f9ca8b475f with identifier: SD56970
2026-03-30 09:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0129520f-95c4-5782-8c70-d8f9ca8b475f with identifier: SD56970
2026-03-30 09:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0129520f-95c4-5782-8c70-d8f9ca8b475f with identifier: SD56970 to the API
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 106,
 'expiration_date': '2026-03-30T15:21:48Z',
 'fuel_type': 'petrol',
 'id': '0129520f-95c4-5782-8c70-d8f9ca8b475f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD56970',
 'listing': 'auction',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 19839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-13',
 'seller_name': None,
 'title': 'MG ZS 1.5 VTi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2024}
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD56970%27 HTTP/1.1" 200 None
2026-03-30 09:11:13 [auto1.it] INFO: Saving data for SD56970: {'auction_closing_time': 1774884108.0, 'created_time': 1774775164.809461, 'last_price_update_time': 1774861873.365686}
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD56970') HTTP/1.1" 204 0
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_96e3201c7d67c22c55f2bd0d226cf98d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96e3201c7d67c22c55f2bd0d226cf98d.jpg not downloaded yet
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_f93c26b61fe3cd4296f7d6171752d6ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_f93c26b61fe3cd4296f7d6171752d6ef.jpg not downloaded yet
2026-03-30 09:11:13 [auto1.it] INFO: Found listing with ID: ZU40989
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU40989%27 HTTP/1.1" 200 None
2026-03-30 09:11:13 [auto1.it] INFO: Scrape type for ZU40989: 2
2026-03-30 09:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52cd9a1a-2cac-5ed2-8c7c-4fca18855f97 with identifier: ZU40989
2026-03-30 09:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52cd9a1a-2cac-5ed2-8c7c-4fca18855f97 with scrape type 2
2026-03-30 09:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52cd9a1a-2cac-5ed2-8c7c-4fca18855f97 with scrape type 2
2026-03-30 09:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 52cd9a1a-2cac-5ed2-8c7c-4fca18855f97, identifier: ZU40989
2026-03-30 09:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:13 [auto1.it] INFO: Found listing with ID: RZ83260
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ83260%27 HTTP/1.1" 200 None
2026-03-30 09:11:13 [auto1.it] INFO: Scrape type for RZ83260: 2
2026-03-30 09:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf1d2ba-5c82-5cb7-b697-06910e27bd28 with identifier: RZ83260
2026-03-30 09:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf1d2ba-5c82-5cb7-b697-06910e27bd28 with scrape type 2
2026-03-30 09:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cf1d2ba-5c82-5cb7-b697-06910e27bd28 with scrape type 2
2026-03-30 09:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1cf1d2ba-5c82-5cb7-b697-06910e27bd28, identifier: RZ83260
2026-03-30 09:11:13 [auto1.it] INFO: Found listing with ID: RA13201
2026-03-30 09:11:13 [auto1.it] INFO: Found listing with ID: CW79165
2026-03-30 09:11:13 [auto1.it] INFO: Found listing with ID: VT45573
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT45573%27 HTTP/1.1" 200 None
2026-03-30 09:11:13 [auto1.it] INFO: Scrape type for VT45573: 0
2026-03-30 09:11:13 [auto1.it] INFO: Found listing with ID: DN35896
2026-03-30 09:11:13 [auto1.it] INFO: Found listing with ID: SH22668
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH22668%27 HTTP/1.1" 200 None
2026-03-30 09:11:13 [auto1.it] INFO: Scrape type for SH22668: 2
2026-03-30 09:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 100eb666-3704-5bf0-8025-5ab094f69ce8 with identifier: SH22668
2026-03-30 09:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 100eb666-3704-5bf0-8025-5ab094f69ce8 with scrape type 2
2026-03-30 09:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 100eb666-3704-5bf0-8025-5ab094f69ce8 with scrape type 2
2026-03-30 09:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 100eb666-3704-5bf0-8025-5ab094f69ce8, identifier: SH22668
2026-03-30 09:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 52cd9a1a-2cac-5ed2-8c7c-4fca18855f97 with identifier: ZU40989
2026-03-30 09:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 52cd9a1a-2cac-5ed2-8c7c-4fca18855f97 with identifier: ZU40989
2026-03-30 09:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 52cd9a1a-2cac-5ed2-8c7c-4fca18855f97 with identifier: ZU40989 to the API
2026-03-30 09:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:34Z',
 'fuel_type': 'diesel',
 'id': '52cd9a1a-2cac-5ed2-8c7c-4fca18855f97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU40989',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 74475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-08',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-30 09:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU40989%27 HTTP/1.1" 200 None
2026-03-30 09:11:14 [auto1.it] INFO: Saving data for ZU40989: {'auction_closing_time': 1774884874.0, 'created_time': 1774775165.740245, 'last_price_update_time': 1774861874.860649}
2026-03-30 09:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU40989') HTTP/1.1" 204 0
2026-03-30 09:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP88006> (referer: https://www.auto1.com/v1/car-details-view/YP88006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT53783> (referer: https://www.auto1.com/v1/car-details-view/JT53783/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1cf1d2ba-5c82-5cb7-b697-06910e27bd28 with identifier: RZ83260
2026-03-30 09:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1cf1d2ba-5c82-5cb7-b697-06910e27bd28 with identifier: RZ83260
2026-03-30 09:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1cf1d2ba-5c82-5cb7-b697-06910e27bd28 with identifier: RZ83260 to the API
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:22:27Z',
 'fuel_type': 'petrol',
 'id': '1cf1d2ba-5c82-5cb7-b697-06910e27bd28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ83260',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 69241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-20',
 'seller_name': None,
 'title': 'Renault Laguna 2.0 Initiale',
 'transmission': 'manual',
 'trim': 'Initiale',
 'year': 2003}
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ83260%27 HTTP/1.1" 200 None
2026-03-30 09:11:15 [auto1.it] INFO: Saving data for RZ83260: {'auction_closing_time': 1774884147.0, 'created_time': 1774645791.449973, 'last_price_update_time': 1774861875.251785}
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RZ83260') HTTP/1.1" 204 0
2026-03-30 09:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 100eb666-3704-5bf0-8025-5ab094f69ce8 with identifier: SH22668
2026-03-30 09:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 100eb666-3704-5bf0-8025-5ab094f69ce8 with identifier: SH22668
2026-03-30 09:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 100eb666-3704-5bf0-8025-5ab094f69ce8 with identifier: SH22668 to the API
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-30T15:55:35Z',
 'fuel_type': 'petrol',
 'id': '100eb666-3704-5bf0-8025-5ab094f69ce8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH22668',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 34905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-09-30',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Alizé',
 'transmission': 'manual',
 'trim': 'Alizé',
 'year': 1997}
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH22668%27 HTTP/1.1" 200 None
2026-03-30 09:11:15 [auto1.it] INFO: Saving data for SH22668: {'auction_closing_time': 1774886135.0, 'created_time': 1774101994.473559, 'last_price_update_time': 1774861875.534468}
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SH22668') HTTP/1.1" 204 0
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_7b670973900c0639cc41e06023e1f2c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_7b670973900c0639cc41e06023e1f2c8.jpg not downloaded yet
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_682a476b35b7012381c27554f70ae52a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_682a476b35b7012381c27554f70ae52a.jpg not downloaded yet
2026-03-30 09:11:15 [auto1.it] INFO: Found listing with ID: DM38646
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM38646%27 HTTP/1.1" 200 None
2026-03-30 09:11:15 [auto1.it] INFO: Scrape type for DM38646: 2
2026-03-30 09:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e2b6f05-0e90-5b39-939d-35ecf58517c0 with identifier: DM38646
2026-03-30 09:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e2b6f05-0e90-5b39-939d-35ecf58517c0 with scrape type 2
2026-03-30 09:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e2b6f05-0e90-5b39-939d-35ecf58517c0 with scrape type 2
2026-03-30 09:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8e2b6f05-0e90-5b39-939d-35ecf58517c0, identifier: DM38646
2026-03-30 09:11:15 [auto1.it] INFO: Found listing with ID: TV98220
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV98220%27 HTTP/1.1" 200 None
2026-03-30 09:11:15 [auto1.it] INFO: Scrape type for TV98220: 2
2026-03-30 09:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 669481c4-6e08-5484-82f6-6c1875a6fc2f with identifier: TV98220
2026-03-30 09:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 669481c4-6e08-5484-82f6-6c1875a6fc2f with scrape type 2
2026-03-30 09:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 669481c4-6e08-5484-82f6-6c1875a6fc2f with scrape type 2
2026-03-30 09:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 669481c4-6e08-5484-82f6-6c1875a6fc2f, identifier: TV98220
2026-03-30 09:11:15 [auto1.it] INFO: Found listing with ID: ZN78264
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN78264%27 HTTP/1.1" 200 None
2026-03-30 09:11:15 [auto1.it] INFO: Scrape type for ZN78264: 2
2026-03-30 09:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 057f5489-781f-5020-beac-1bef2cfc484f with identifier: ZN78264
2026-03-30 09:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 057f5489-781f-5020-beac-1bef2cfc484f with scrape type 2
2026-03-30 09:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 057f5489-781f-5020-beac-1bef2cfc484f with scrape type 2
2026-03-30 09:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 057f5489-781f-5020-beac-1bef2cfc484f, identifier: ZN78264
2026-03-30 09:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8e2b6f05-0e90-5b39-939d-35ecf58517c0 with identifier: DM38646
2026-03-30 09:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8e2b6f05-0e90-5b39-939d-35ecf58517c0 with identifier: DM38646
2026-03-30 09:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8e2b6f05-0e90-5b39-939d-35ecf58517c0 with identifier: DM38646 to the API
2026-03-30 09:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:21:32Z',
 'fuel_type': 'petrol',
 'id': '8e2b6f05-0e90-5b39-939d-35ecf58517c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM38646',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 82639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2020}
2026-03-30 09:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM38646%27 HTTP/1.1" 200 None
2026-03-30 09:11:16 [auto1.it] INFO: Saving data for DM38646: {'auction_closing_time': 1774884092.0, 'created_time': 1774775157.608795, 'last_price_update_time': 1774861876.652001}
2026-03-30 09:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DM38646') HTTP/1.1" 204 0
2026-03-30 09:11:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee258ab90>
2026-03-30 09:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F30%252Fcd30fe65d6e7cd20102ce16484b0693c%252Fpa%252FPP36077_4c69f4a7482985609e11c70d76c53151.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_4c69f4a7482985609e11c70d76c53151.jpg saved to cache
2026-03-30 09:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582
2026-03-30 09:11:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a61bcd7-3cf4-5369-b8b9-eef30b807582, skipping ID generation
2026-03-30 09:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582 with scrape type 1
2026-03-30 09:11:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a61bcd7-3cf4-5369-b8b9-eef30b807582 sending to next pipeline
2026-03-30 09:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a61bcd7-3cf4-5369-b8b9-eef30b807582, identifier: PP36077
2026-03-30 09:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 669481c4-6e08-5484-82f6-6c1875a6fc2f with identifier: TV98220
2026-03-30 09:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 669481c4-6e08-5484-82f6-6c1875a6fc2f with identifier: TV98220
2026-03-30 09:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 669481c4-6e08-5484-82f6-6c1875a6fc2f with identifier: TV98220 to the API
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:28:01Z',
 'fuel_type': 'diesel',
 'id': '669481c4-6e08-5484-82f6-6c1875a6fc2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV98220',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 115332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-20',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.7 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2006}
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV98220%27 HTTP/1.1" 200 None
2026-03-30 09:11:17 [auto1.it] INFO: Saving data for TV98220: {'auction_closing_time': 1774884481.0, 'created_time': 1774386800.366184, 'last_price_update_time': 1774861877.201338}
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TV98220') HTTP/1.1" 204 0
2026-03-30 09:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 057f5489-781f-5020-beac-1bef2cfc484f with identifier: ZN78264
2026-03-30 09:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 057f5489-781f-5020-beac-1bef2cfc484f with identifier: ZN78264
2026-03-30 09:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 057f5489-781f-5020-beac-1bef2cfc484f with identifier: ZN78264 to the API
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:47:45Z',
 'fuel_type': 'petrol',
 'id': '057f5489-781f-5020-beac-1bef2cfc484f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN78264',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 274505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-30',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Spirit",
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2009}
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN78264%27 HTTP/1.1" 200 None
2026-03-30 09:11:17 [auto1.it] INFO: Saving data for ZN78264: {'auction_closing_time': 1774885665.0, 'created_time': 1774645785.960242, 'last_price_update_time': 1774861877.528372}
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZN78264') HTTP/1.1" 204 0
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_ae50c2c0b42001b7182b55ef8a4b3805.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_ae50c2c0b42001b7182b55ef8a4b3805.jpg not downloaded yet
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_54577c9c69054201402c390d8202040e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_54577c9c69054201402c390d8202040e.jpg not downloaded yet
2026-03-30 09:11:17 [auto1.it] INFO: Found listing with ID: YA96352
2026-03-30 09:11:17 [auto1.it] INFO: Found listing with ID: NJ11800
2026-03-30 09:11:17 [auto1.it] INFO: Found listing with ID: EA59370
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA59370%27 HTTP/1.1" 200 None
2026-03-30 09:11:17 [auto1.it] INFO: Scrape type for EA59370: 2
2026-03-30 09:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea457354-8952-551b-81e8-cca6621a2db8 with identifier: EA59370
2026-03-30 09:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea457354-8952-551b-81e8-cca6621a2db8 with scrape type 2
2026-03-30 09:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea457354-8952-551b-81e8-cca6621a2db8 with scrape type 2
2026-03-30 09:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea457354-8952-551b-81e8-cca6621a2db8, identifier: EA59370
2026-03-30 09:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a61bcd7-3cf4-5369-b8b9-eef30b807582 with identifier: PP36077
2026-03-30 09:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a61bcd7-3cf4-5369-b8b9-eef30b807582 with identifier: PP36077
2026-03-30 09:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a61bcd7-3cf4-5369-b8b9-eef30b807582 with identifier: PP36077 to the API
2026-03-30 09:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_4c69f4a7482985609e11c70d76c53151.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:11:15Z',
 'fuel_type': 'hybrid',
 'id': '4a61bcd7-3cf4-5369-b8b9-eef30b807582',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP36077',
 'listing': 'auction',
 'location': 'IT, Marino',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 18966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2868032,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_fce0fbb76d693bed2c20a245d2e5e619.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_bce9899feb13d780cee4e4f27979ba7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_8944f5acf8cd83c7a109a5ae22111da5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_e517c9140c13bc5442ec4c3cb4f128b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_38b0595dcacc039b82b52547f19f60c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_bb1e120d26d9a9d6be5f293cb6917256.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_3950b5e602fd8238990ced7db4e08a19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_60f83241a6f28006357b718aca3aadb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2944699,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_4c69f4a7482985609e11c70d76c53151.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a61bcd7-3cf4-5369-b8b9-eef30b807582/4a61bcd7-3cf4-5369-b8b9-eef30b807582_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/30/cd30fe65d6e7cd20102ce16484b0693c/pa/PP36077_d314b70f9cc205f2917e1818652c51b6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Premiere Edition',
 'transmission': 'automatic',
 'trim': '2WD Premiere Edition',
 'year': 2021}
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP36077%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [auto1.it] INFO: Saving data for PP36077: {'created_time': 1774861878.158856, 'last_price_update_time': 1774861878.158872, 'auction_closing_time': 1774969875.0}
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PP36077') HTTP/1.1" 204 0
2026-03-30 09:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_c3092e96d70cc245e800b26dfe67bd59.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:18 [auto1.it] INFO: Found listing with ID: JT03788
2026-03-30 09:11:18 [auto1.it] INFO: Found listing with ID: LJ66160
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ66160%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [auto1.it] INFO: Scrape type for LJ66160: 2
2026-03-30 09:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3a02411-bd73-58b1-91f9-556659b859ff with identifier: LJ66160
2026-03-30 09:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3a02411-bd73-58b1-91f9-556659b859ff with scrape type 2
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3a02411-bd73-58b1-91f9-556659b859ff with scrape type 2
2026-03-30 09:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c3a02411-bd73-58b1-91f9-556659b859ff, identifier: LJ66160
2026-03-30 09:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea457354-8952-551b-81e8-cca6621a2db8 with identifier: EA59370
2026-03-30 09:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea457354-8952-551b-81e8-cca6621a2db8 with identifier: EA59370
2026-03-30 09:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea457354-8952-551b-81e8-cca6621a2db8 with identifier: EA59370 to the API
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:50:02Z',
 'fuel_type': 'diesel',
 'id': 'ea457354-8952-551b-81e8-cca6621a2db8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA59370',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 141928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-06',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Style 4WD',
 'transmission': 'automatic',
 'trim': 'Style 4WD',
 'year': 2015}
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA59370%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [auto1.it] INFO: Saving data for EA59370: {'auction_closing_time': 1774885802.0, 'created_time': 1774775158.241348, 'last_price_update_time': 1774861878.574386}
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA59370') HTTP/1.1" 204 0
2026-03-30 09:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04eda6bc-9bb0-5360-a107-466353a9cd1c with identifier: YP88006
2026-03-30 09:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04eda6bc-9bb0-5360-a107-466353a9cd1c with scrape type 1
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 04eda6bc-9bb0-5360-a107-466353a9cd1c
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa2%252F50a224ede647473dcb61051a087f8b43%252Fpa%252FYP88006_558c6841f2752cc102ad0b9598b74cc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_558c6841f2752cc102ad0b9598b74cc9.jpg not downloaded yet
2026-03-30 09:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ce29bd4-3846-5f53-947a-acc35716ca8c with identifier: JT53783
2026-03-30 09:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce29bd4-3846-5f53-947a-acc35716ca8c with scrape type 1
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ce29bd4-3846-5f53-947a-acc35716ca8c
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F86%252Fc2865d35fef3c1bc3bb5bc87b7495cea%252Fpa%252FJT53783_2d7b3003488f9cdbee82a9371d29b4e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_2d7b3003488f9cdbee82a9371d29b4e4.jpg already downloaded
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F86%252Fc2865d35fef3c1bc3bb5bc87b7495cea%252Fpa%252FJT53783_ab835dd1ae441960f80fd4cb4e392f69.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_ab835dd1ae441960f80fd4cb4e392f69.jpg already downloaded
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F86%252Fc2865d35fef3c1bc3bb5bc87b7495cea%252Fpa%252FJT53783_daf374f9fccddc172cd94533aadada00.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_daf374f9fccddc172cd94533aadada00.jpg already downloaded
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F86%252Fc2865d35fef3c1bc3bb5bc87b7495cea%252Fpa%252FJT53783_ccc6e4560645a6c11517ed4123249c10.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_ccc6e4560645a6c11517ed4123249c10.jpg already downloaded
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F86%252Fc2865d35fef3c1bc3bb5bc87b7495cea%252Fpa%252FJT53783_e8722ec6f5a33ad87346bbe48116c12b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_e8722ec6f5a33ad87346bbe48116c12b.jpg already downloaded
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F86%252Fc2865d35fef3c1bc3bb5bc87b7495cea%252Fpa%252FJT53783_f64b9dca540be1718fc8d30344dc4978.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_f64b9dca540be1718fc8d30344dc4978.jpg already downloaded
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F86%252Fc2865d35fef3c1bc3bb5bc87b7495cea%252Fpa%252FJT53783_6032e75f3cbbfc591dfccd9f134bf93e.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_6032e75f3cbbfc591dfccd9f134bf93e.jpg already downloaded
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F86%252Fc2865d35fef3c1bc3bb5bc87b7495cea%252Fpa%252FJT53783_80df501dbdc5b433ba65aac9d596d976.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_80df501dbdc5b433ba65aac9d596d976.jpg already downloaded
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F86%252Fc2865d35fef3c1bc3bb5bc87b7495cea%252Fpa%252FJT53783_40ab604a5670b2b83e30a03db5a9ea09.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_40ab604a5670b2b83e30a03db5a9ea09.jpg already downloaded
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F86%252Fc2865d35fef3c1bc3bb5bc87b7495cea%252Fpa%252FJT53783_f5458f4ceb32a6cf9f6fdbf3d0b3eb5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_f5458f4ceb32a6cf9f6fdbf3d0b3eb5d.jpg already downloaded
2026-03-30 09:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2ce29bd4-3846-5f53-947a-acc35716ca8c, identifier: JT53783
2026-03-30 09:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c3a02411-bd73-58b1-91f9-556659b859ff with identifier: LJ66160
2026-03-30 09:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c3a02411-bd73-58b1-91f9-556659b859ff with identifier: LJ66160
2026-03-30 09:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c3a02411-bd73-58b1-91f9-556659b859ff with identifier: LJ66160 to the API
2026-03-30 09:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:19:29Z',
 'fuel_type': 'diesel',
 'id': 'c3a02411-bd73-58b1-91f9-556659b859ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ66160',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 22942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-26',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Mild-Hybrid GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2022}
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ66160%27 HTTP/1.1" 200 None
2026-03-30 09:11:19 [auto1.it] INFO: Saving data for LJ66160: {'auction_closing_time': 1774883969.0, 'created_time': 1774775154.138241, 'last_price_update_time': 1774861879.148847}
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LJ66160') HTTP/1.1" 204 0
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_e1c193f450d19c7f51ae94754b08e95c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_e1c193f450d19c7f51ae94754b08e95c.jpg not downloaded yet
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_5aaa2745f7168647e4ed1b39b38c2fe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_5aaa2745f7168647e4ed1b39b38c2fe0.jpg not downloaded yet
2026-03-30 09:11:19 [auto1.it] INFO: Found listing with ID: MD00417
2026-03-30 09:11:19 [auto1.it] INFO: Found listing with ID: NK45302
2026-03-30 09:11:19 [auto1.it] INFO: Found listing with ID: LE83357
2026-03-30 09:11:19 [auto1.it] INFO: Found listing with ID: ZC32771
2026-03-30 09:11:19 [auto1.it] INFO: Found listing with ID: DX48884
2026-03-30 09:11:19 [auto1.it] INFO: Found listing with ID: GJ25727
2026-03-30 09:11:19 [auto1.it] INFO: Found listing with ID: EM71095
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM71095%27 HTTP/1.1" 200 None
2026-03-30 09:11:19 [auto1.it] INFO: Scrape type for EM71095: 0
2026-03-30 09:11:19 [auto1.it] INFO: Found listing with ID: BU87588
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU87588%27 HTTP/1.1" 200 None
2026-03-30 09:11:19 [auto1.it] INFO: Scrape type for BU87588: 2
2026-03-30 09:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a23754c8-7a89-5bcc-bc80-07336fec47dc with identifier: BU87588
2026-03-30 09:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a23754c8-7a89-5bcc-bc80-07336fec47dc with scrape type 2
2026-03-30 09:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a23754c8-7a89-5bcc-bc80-07336fec47dc with scrape type 2
2026-03-30 09:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a23754c8-7a89-5bcc-bc80-07336fec47dc, identifier: BU87588
2026-03-30 09:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2ce29bd4-3846-5f53-947a-acc35716ca8c with identifier: JT53783
2026-03-30 09:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2ce29bd4-3846-5f53-947a-acc35716ca8c with identifier: JT53783
2026-03-30 09:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2ce29bd4-3846-5f53-947a-acc35716ca8c with identifier: JT53783 to the API
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JT53783>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': 'Taxi',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:32:59Z',
 'fuel_type': 'petrol',
 'id': '2ce29bd4-3846-5f53-947a-acc35716ca8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT53783',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 199354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_2d7b3003488f9cdbee82a9371d29b4e4.jpg',
                'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_ab835dd1ae441960f80fd4cb4e392f69.jpg',
                'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_daf374f9fccddc172cd94533aadada00.jpg',
                'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_ccc6e4560645a6c11517ed4123249c10.jpg',
                'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_e8722ec6f5a33ad87346bbe48116c12b.jpg',
                'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_f64b9dca540be1718fc8d30344dc4978.jpg',
                'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_6032e75f3cbbfc591dfccd9f134bf93e.jpg',
                'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_80df501dbdc5b433ba65aac9d596d976.jpg',
                'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_40ab604a5670b2b83e30a03db5a9ea09.jpg',
                'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_f5458f4ceb32a6cf9f6fdbf3d0b3eb5d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce29bd4-3846-5f53-947a-acc35716ca8c/2ce29bd4-3846-5f53-947a-acc35716ca8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_2d7b3003488f9cdbee82a9371d29b4e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce29bd4-3846-5f53-947a-acc35716ca8c/2ce29bd4-3846-5f53-947a-acc35716ca8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2493834,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_ab835dd1ae441960f80fd4cb4e392f69.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce29bd4-3846-5f53-947a-acc35716ca8c/2ce29bd4-3846-5f53-947a-acc35716ca8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_daf374f9fccddc172cd94533aadada00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce29bd4-3846-5f53-947a-acc35716ca8c/2ce29bd4-3846-5f53-947a-acc35716ca8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_ccc6e4560645a6c11517ed4123249c10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce29bd4-3846-5f53-947a-acc35716ca8c/2ce29bd4-3846-5f53-947a-acc35716ca8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2291448,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_e8722ec6f5a33ad87346bbe48116c12b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce29bd4-3846-5f53-947a-acc35716ca8c/2ce29bd4-3846-5f53-947a-acc35716ca8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1640733,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_f64b9dca540be1718fc8d30344dc4978.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce29bd4-3846-5f53-947a-acc35716ca8c/2ce29bd4-3846-5f53-947a-acc35716ca8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_6032e75f3cbbfc591dfccd9f134bf93e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce29bd4-3846-5f53-947a-acc35716ca8c/2ce29bd4-3846-5f53-947a-acc35716ca8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_80df501dbdc5b433ba65aac9d596d976.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce29bd4-3846-5f53-947a-acc35716ca8c/2ce29bd4-3846-5f53-947a-acc35716ca8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_40ab604a5670b2b83e30a03db5a9ea09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ce29bd4-3846-5f53-947a-acc35716ca8c/2ce29bd4-3846-5f53-947a-acc35716ca8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/86/c2865d35fef3c1bc3bb5bc87b7495cea/pa/JT53783_f5458f4ceb32a6cf9f6fdbf3d0b3eb5d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2018}
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT53783%27 HTTP/1.1" 200 None
2026-03-30 09:11:19 [auto1.it] INFO: Saving data for JT53783: {'created_time': 1774861879.758786, 'last_price_update_time': 1774861879.758796, 'auction_closing_time': 1774971179.0}
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JT53783') HTTP/1.1" 204 0
2026-03-30 09:11:19 [auto1.it] INFO: Found listing with ID: YA14449
2026-03-30 09:11:19 [auto1.it] INFO: Found listing with ID: NV42122
2026-03-30 09:11:19 [auto1.it] INFO: Found listing with ID: JZ43630
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ43630%27 HTTP/1.1" 200 None
2026-03-30 09:11:19 [auto1.it] INFO: Scrape type for JZ43630: 2
2026-03-30 09:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35909d80-29c0-55dc-bff4-4a377d9b9e9d with identifier: JZ43630
2026-03-30 09:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35909d80-29c0-55dc-bff4-4a377d9b9e9d with scrape type 2
2026-03-30 09:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35909d80-29c0-55dc-bff4-4a377d9b9e9d with scrape type 2
2026-03-30 09:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 35909d80-29c0-55dc-bff4-4a377d9b9e9d, identifier: JZ43630
2026-03-30 09:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a23754c8-7a89-5bcc-bc80-07336fec47dc with identifier: BU87588
2026-03-30 09:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a23754c8-7a89-5bcc-bc80-07336fec47dc with identifier: BU87588
2026-03-30 09:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a23754c8-7a89-5bcc-bc80-07336fec47dc with identifier: BU87588 to the API
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:12:51Z',
 'fuel_type': 'diesel',
 'id': 'a23754c8-7a89-5bcc-bc80-07336fec47dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU87588',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 225808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-04',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.8 CRD Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2009}
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU87588%27 HTTP/1.1" 200 None
2026-03-30 09:11:20 [auto1.it] INFO: Saving data for BU87588: {'auction_closing_time': 1774883571.0, 'created_time': 1772752109.218898, 'last_price_update_time': 1774861880.253567}
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BU87588') HTTP/1.1" 204 0
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa2%252F50a224ede647473dcb61051a087f8b43%252Fpa%252FYP88006_003ec9f4e3a78eb60f9f464c61f1549c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_003ec9f4e3a78eb60f9f464c61f1549c.jpg not downloaded yet
2026-03-30 09:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_f93c26b61fe3cd4296f7d6171752d6ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96e3201c7d67c22c55f2bd0d226cf98d.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 35909d80-29c0-55dc-bff4-4a377d9b9e9d with identifier: JZ43630
2026-03-30 09:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 35909d80-29c0-55dc-bff4-4a377d9b9e9d with identifier: JZ43630
2026-03-30 09:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 35909d80-29c0-55dc-bff4-4a377d9b9e9d with identifier: JZ43630 to the API
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:04Z',
 'fuel_type': 'diesel',
 'id': '35909d80-29c0-55dc-bff4-4a377d9b9e9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ43630',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 113065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-25',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2016}
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ43630%27 HTTP/1.1" 200 None
2026-03-30 09:11:20 [auto1.it] INFO: Saving data for JZ43630: {'auction_closing_time': 1774886164.0, 'created_time': 1774775153.45338, 'last_price_update_time': 1774861880.557784}
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ43630') HTTP/1.1" 204 0
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_8b0d33cd50f9bc83de049a778e6bf2ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8b0d33cd50f9bc83de049a778e6bf2ed.jpg not downloaded yet
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_2a9f9327f19dff4db218f8132409d1da.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_2a9f9327f19dff4db218f8132409d1da.jpg not downloaded yet
2026-03-30 09:11:20 [auto1.it] INFO: Found listing with ID: CS73145
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS73145%27 HTTP/1.1" 200 None
2026-03-30 09:11:20 [auto1.it] INFO: Scrape type for CS73145: 2
2026-03-30 09:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ae93fe3-8727-5f36-a392-072e1dab97e3 with identifier: CS73145
2026-03-30 09:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ae93fe3-8727-5f36-a392-072e1dab97e3 with scrape type 2
2026-03-30 09:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ae93fe3-8727-5f36-a392-072e1dab97e3 with scrape type 2
2026-03-30 09:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ae93fe3-8727-5f36-a392-072e1dab97e3, identifier: CS73145
2026-03-30 09:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_7b670973900c0639cc41e06023e1f2c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:20 [auto1.it] INFO: Found listing with ID: TT43912
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT43912%27 HTTP/1.1" 200 None
2026-03-30 09:11:20 [auto1.it] INFO: Scrape type for TT43912: 2
2026-03-30 09:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cfb5ec2-6927-5ee6-a779-244d65168535 with identifier: TT43912
2026-03-30 09:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cfb5ec2-6927-5ee6-a779-244d65168535 with scrape type 2
2026-03-30 09:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cfb5ec2-6927-5ee6-a779-244d65168535 with scrape type 2
2026-03-30 09:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3cfb5ec2-6927-5ee6-a779-244d65168535, identifier: TT43912
2026-03-30 09:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ae93fe3-8727-5f36-a392-072e1dab97e3 with identifier: CS73145
2026-03-30 09:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ae93fe3-8727-5f36-a392-072e1dab97e3 with identifier: CS73145
2026-03-30 09:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ae93fe3-8727-5f36-a392-072e1dab97e3 with identifier: CS73145 to the API
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:49:12Z',
 'fuel_type': 'diesel',
 'id': '5ae93fe3-8727-5f36-a392-072e1dab97e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS73145',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 175511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-19',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 TDCi Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS73145%27 HTTP/1.1" 200 None
2026-03-30 09:11:21 [auto1.it] INFO: Saving data for CS73145: {'auction_closing_time': 1774885752.0, 'created_time': 1773695402.811929, 'last_price_update_time': 1774861881.10606}
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CS73145') HTTP/1.1" 204 0
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa2%252F50a224ede647473dcb61051a087f8b43%252Fpa%252FYP88006_30c4188a6a59874406e34f560e4ebec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_30c4188a6a59874406e34f560e4ebec7.jpg not downloaded yet
2026-03-30 09:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee285cf10>
2026-03-30 09:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_c3092e96d70cc245e800b26dfe67bd59.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_c3092e96d70cc245e800b26dfe67bd59.jpg saved to cache
2026-03-30 09:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c554bb5-b057-521f-b650-242ef5e471bb
2026-03-30 09:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3cfb5ec2-6927-5ee6-a779-244d65168535 with identifier: TT43912
2026-03-30 09:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3cfb5ec2-6927-5ee6-a779-244d65168535 with identifier: TT43912
2026-03-30 09:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3cfb5ec2-6927-5ee6-a779-244d65168535 with identifier: TT43912 to the API
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:12:06Z',
 'fuel_type': 'diesel',
 'id': '3cfb5ec2-6927-5ee6-a779-244d65168535',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT43912',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 25843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-04',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2024}
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT43912%27 HTTP/1.1" 200 None
2026-03-30 09:11:21 [auto1.it] INFO: Saving data for TT43912: {'auction_closing_time': 1774883526.0, 'created_time': 1774775151.696719, 'last_price_update_time': 1774861881.548346}
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TT43912') HTTP/1.1" 204 0
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_6afa8b815d3a18fcc400c9ab128ed2a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_6afa8b815d3a18fcc400c9ab128ed2a0.jpg not downloaded yet
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_ea83a6dc092f197733916b8748b40b20.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_ea83a6dc092f197733916b8748b40b20.jpg not downloaded yet
2026-03-30 09:11:21 [auto1.it] INFO: Found listing with ID: PF00609
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF00609%27 HTTP/1.1" 200 None
2026-03-30 09:11:21 [auto1.it] INFO: Scrape type for PF00609: 2
2026-03-30 09:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe9a1c7-ee00-5619-ba29-49a954a9e263 with identifier: PF00609
2026-03-30 09:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe9a1c7-ee00-5619-ba29-49a954a9e263 with scrape type 2
2026-03-30 09:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe9a1c7-ee00-5619-ba29-49a954a9e263 with scrape type 2
2026-03-30 09:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5fe9a1c7-ee00-5619-ba29-49a954a9e263, identifier: PF00609
2026-03-30 09:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_ae50c2c0b42001b7182b55ef8a4b3805.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:21 [auto1.it] INFO: Found listing with ID: AG55709
2026-03-30 09:11:21 [auto1.it] INFO: Found listing with ID: UZ37756
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ37756%27 HTTP/1.1" 200 None
2026-03-30 09:11:21 [auto1.it] INFO: Scrape type for UZ37756: 2
2026-03-30 09:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b10d4a63-c9ae-5272-b8ed-db8d212916b5 with identifier: UZ37756
2026-03-30 09:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b10d4a63-c9ae-5272-b8ed-db8d212916b5 with scrape type 2
2026-03-30 09:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b10d4a63-c9ae-5272-b8ed-db8d212916b5 with scrape type 2
2026-03-30 09:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b10d4a63-c9ae-5272-b8ed-db8d212916b5, identifier: UZ37756
2026-03-30 09:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5fe9a1c7-ee00-5619-ba29-49a954a9e263 with identifier: PF00609
2026-03-30 09:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5fe9a1c7-ee00-5619-ba29-49a954a9e263 with identifier: PF00609
2026-03-30 09:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5fe9a1c7-ee00-5619-ba29-49a954a9e263 with identifier: PF00609 to the API
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:10:37Z',
 'fuel_type': 'diesel',
 'id': '5fe9a1c7-ee00-5619-ba29-49a954a9e263',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF00609',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 170 CDI L Elegance',
 'transmission': 'manual',
 'trim': 'L Elegance',
 'year': 2003}
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF00609%27 HTTP/1.1" 200 None
2026-03-30 09:11:22 [auto1.it] INFO: Saving data for PF00609: {'auction_closing_time': 1774883437.0, 'created_time': 1773489948.101016, 'last_price_update_time': 1774861882.098681}
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PF00609') HTTP/1.1" 204 0
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa2%252F50a224ede647473dcb61051a087f8b43%252Fpa%252FYP88006_26baa594d49d7439b39c1a9c2ecf7a97.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_26baa594d49d7439b39c1a9c2ecf7a97.jpg not downloaded yet
2026-03-30 09:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_558c6841f2752cc102ad0b9598b74cc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_54577c9c69054201402c390d8202040e.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b10d4a63-c9ae-5272-b8ed-db8d212916b5 with identifier: UZ37756
2026-03-30 09:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b10d4a63-c9ae-5272-b8ed-db8d212916b5 with identifier: UZ37756
2026-03-30 09:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b10d4a63-c9ae-5272-b8ed-db8d212916b5 with identifier: UZ37756 to the API
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:33:50Z',
 'fuel_type': 'diesel',
 'id': 'b10d4a63-c9ae-5272-b8ed-db8d212916b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ37756',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 133915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-13',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 dCi Sport Edition 2',
 'transmission': 'automatic',
 'trim': 'Sport Edition 2',
 'year': 2018}
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ37756%27 HTTP/1.1" 200 None
2026-03-30 09:11:22 [auto1.it] INFO: Saving data for UZ37756: {'auction_closing_time': 1774884830.0, 'created_time': 1774775161.591479, 'last_price_update_time': 1774861882.424419}
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ37756') HTTP/1.1" 204 0
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_96d860c88bd7bc878a0981a57c32070b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96d860c88bd7bc878a0981a57c32070b.jpg not downloaded yet
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_73b3604599421bc21ae3d1bb04d42b82.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_73b3604599421bc21ae3d1bb04d42b82.jpg not downloaded yet
2026-03-30 09:11:22 [auto1.it] INFO: Found listing with ID: VJ94912
2026-03-30 09:11:22 [auto1.it] INFO: Found listing with ID: MU64340
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU64340%27 HTTP/1.1" 200 None
2026-03-30 09:11:22 [auto1.it] INFO: Scrape type for MU64340: 2
2026-03-30 09:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 700b121d-db94-52af-abc9-a5a52907f3a5 with identifier: MU64340
2026-03-30 09:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 700b121d-db94-52af-abc9-a5a52907f3a5 with scrape type 2
2026-03-30 09:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 700b121d-db94-52af-abc9-a5a52907f3a5 with scrape type 2
2026-03-30 09:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 700b121d-db94-52af-abc9-a5a52907f3a5, identifier: MU64340
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee0fc2d50>
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_f93c26b61fe3cd4296f7d6171752d6ef.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_f93c26b61fe3cd4296f7d6171752d6ef.jpg saved to cache
2026-03-30 09:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c554bb5-b057-521f-b650-242ef5e471bb
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26abbd0>
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_96e3201c7d67c22c55f2bd0d226cf98d.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96e3201c7d67c22c55f2bd0d226cf98d.jpg saved to cache
2026-03-30 09:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2507a90>
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_7b670973900c0639cc41e06023e1f2c8.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_7b670973900c0639cc41e06023e1f2c8.jpg saved to cache
2026-03-30 09:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-03-30 09:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_e1c193f450d19c7f51ae94754b08e95c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:22 [auto1.it] INFO: Found listing with ID: RW18979
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW18979%27 HTTP/1.1" 200 None
2026-03-30 09:11:22 [auto1.it] INFO: Scrape type for RW18979: 2
2026-03-30 09:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbe37e26-905c-59c2-ac3c-002874745de9 with identifier: RW18979
2026-03-30 09:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbe37e26-905c-59c2-ac3c-002874745de9 with scrape type 2
2026-03-30 09:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbe37e26-905c-59c2-ac3c-002874745de9 with scrape type 2
2026-03-30 09:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cbe37e26-905c-59c2-ac3c-002874745de9, identifier: RW18979
2026-03-30 09:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 700b121d-db94-52af-abc9-a5a52907f3a5 with identifier: MU64340
2026-03-30 09:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 700b121d-db94-52af-abc9-a5a52907f3a5 with identifier: MU64340
2026-03-30 09:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 700b121d-db94-52af-abc9-a5a52907f3a5 with identifier: MU64340 to the API
2026-03-30 09:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:34:24Z',
 'fuel_type': 'diesel',
 'id': '700b121d-db94-52af-abc9-a5a52907f3a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU64340',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 15781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-14',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2024}
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU64340%27 HTTP/1.1" 200 None
2026-03-30 09:11:23 [auto1.it] INFO: Saving data for MU64340: {'auction_closing_time': 1774884864.0, 'created_time': 1774775159.157641, 'last_price_update_time': 1774861883.361479}
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU64340') HTTP/1.1" 204 0
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa2%252F50a224ede647473dcb61051a087f8b43%252Fpa%252FYP88006_407abe2cc8ad36dc9a0f4359722e5a36.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_407abe2cc8ad36dc9a0f4359722e5a36.jpg not downloaded yet
2026-03-30 09:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_003ec9f4e3a78eb60f9f464c61f1549c.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cbe37e26-905c-59c2-ac3c-002874745de9 with identifier: RW18979
2026-03-30 09:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cbe37e26-905c-59c2-ac3c-002874745de9 with identifier: RW18979
2026-03-30 09:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cbe37e26-905c-59c2-ac3c-002874745de9 with identifier: RW18979 to the API
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:53:00Z',
 'fuel_type': 'diesel',
 'id': 'cbe37e26-905c-59c2-ac3c-002874745de9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW18979',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 261186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-31',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Ice',
 'transmission': 'manual',
 'trim': 'Ice',
 'year': 2004}
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW18979%27 HTTP/1.1" 200 None
2026-03-30 09:11:23 [auto1.it] INFO: Saving data for RW18979: {'auction_closing_time': 1774885980.0, 'created_time': 1774645821.831156, 'last_price_update_time': 1774861883.735635}
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RW18979') HTTP/1.1" 204 0
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_cda3054cacc042307dc4182163574a0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_cda3054cacc042307dc4182163574a0a.jpg not downloaded yet
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_faddf8b21b04456cc8ea3850caa0aae5.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_faddf8b21b04456cc8ea3850caa0aae5.jpg not downloaded yet
2026-03-30 09:11:23 [auto1.it] INFO: Found listing with ID: TU34163
2026-03-30 09:11:23 [auto1.it] INFO: Found listing with ID: ZV32235
2026-03-30 09:11:23 [auto1.it] INFO: Found listing with ID: LA78712
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA78712%27 HTTP/1.1" 200 None
2026-03-30 09:11:23 [auto1.it] INFO: Scrape type for LA78712: 2
2026-03-30 09:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a60bac9-6e4a-5013-8c65-4ce840ae2d01 with identifier: LA78712
2026-03-30 09:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a60bac9-6e4a-5013-8c65-4ce840ae2d01 with scrape type 2
2026-03-30 09:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a60bac9-6e4a-5013-8c65-4ce840ae2d01 with scrape type 2
2026-03-30 09:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a60bac9-6e4a-5013-8c65-4ce840ae2d01, identifier: LA78712
2026-03-30 09:11:23 [auto1.it] INFO: Found listing with ID: UT39332
2026-03-30 09:11:23 [auto1.it] INFO: Found listing with ID: NF11774
2026-03-30 09:11:23 [auto1.it] INFO: Found listing with ID: HH94865
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH94865%27 HTTP/1.1" 200 None
2026-03-30 09:11:23 [auto1.it] INFO: Scrape type for HH94865: 2
2026-03-30 09:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b0a2ca-d7d2-5d59-82de-3d2b3d80359b with identifier: HH94865
2026-03-30 09:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b0a2ca-d7d2-5d59-82de-3d2b3d80359b with scrape type 2
2026-03-30 09:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50b0a2ca-d7d2-5d59-82de-3d2b3d80359b with scrape type 2
2026-03-30 09:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 50b0a2ca-d7d2-5d59-82de-3d2b3d80359b, identifier: HH94865
2026-03-30 09:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a60bac9-6e4a-5013-8c65-4ce840ae2d01 with identifier: LA78712
2026-03-30 09:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a60bac9-6e4a-5013-8c65-4ce840ae2d01 with identifier: LA78712
2026-03-30 09:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a60bac9-6e4a-5013-8c65-4ce840ae2d01 with identifier: LA78712 to the API
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:11:34Z',
 'fuel_type': 'diesel',
 'id': '7a60bac9-6e4a-5013-8c65-4ce840ae2d01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA78712',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 231395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-07-21',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.9 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 1999}
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA78712%27 HTTP/1.1" 200 None
2026-03-30 09:11:24 [auto1.it] INFO: Saving data for LA78712: {'auction_closing_time': 1774883494.0, 'created_time': 1774645777.032915, 'last_price_update_time': 1774861884.409325}
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LA78712') HTTP/1.1" 204 0
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12f9550>
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_ae50c2c0b42001b7182b55ef8a4b3805.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_ae50c2c0b42001b7182b55ef8a4b3805.jpg saved to cache
2026-03-30 09:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1430f90>
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04eda6bc-9bb0-5360-a107-466353a9cd1c/04eda6bc-9bb0-5360-a107-466353a9cd1c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa2%252F50a224ede647473dcb61051a087f8b43%252Fpa%252FYP88006_558c6841f2752cc102ad0b9598b74cc9.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_558c6841f2752cc102ad0b9598b74cc9.jpg saved to cache
2026-03-30 09:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04eda6bc-9bb0-5360-a107-466353a9cd1c
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1419cd0>
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_54577c9c69054201402c390d8202040e.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_54577c9c69054201402c390d8202040e.jpg saved to cache
2026-03-30 09:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c554bb5-b057-521f-b650-242ef5e471bb
2026-03-30 09:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8b0d33cd50f9bc83de049a778e6bf2ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_2a9f9327f19dff4db218f8132409d1da.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 50b0a2ca-d7d2-5d59-82de-3d2b3d80359b with identifier: HH94865
2026-03-30 09:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 50b0a2ca-d7d2-5d59-82de-3d2b3d80359b with identifier: HH94865
2026-03-30 09:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 50b0a2ca-d7d2-5d59-82de-3d2b3d80359b with identifier: HH94865 to the API
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:40Z',
 'fuel_type': 'diesel',
 'id': '50b0a2ca-d7d2-5d59-82de-3d2b3d80359b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH94865',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla Verso',
 'odometer': 374948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-31',
 'seller_name': None,
 'title': 'Toyota Corolla Verso 2.2 D-4D Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2006}
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH94865%27 HTTP/1.1" 200 None
2026-03-30 09:11:24 [auto1.it] INFO: Saving data for HH94865: {'auction_closing_time': 1774885360.0, 'created_time': 1774645785.337248, 'last_price_update_time': 1774861884.845963}
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HH94865') HTTP/1.1" 204 0
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_3edcf53f98a45f3fcdaf27f9d93311f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_3edcf53f98a45f3fcdaf27f9d93311f3.jpg not downloaded yet
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_bf7e96003db69d118df5f705ce8ce512.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_bf7e96003db69d118df5f705ce8ce512.jpg not downloaded yet
2026-03-30 09:11:24 [auto1.it] INFO: Found listing with ID: UU36082
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU36082%27 HTTP/1.1" 200 None
2026-03-30 09:11:24 [auto1.it] INFO: Scrape type for UU36082: 2
2026-03-30 09:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a00ecdb4-58b4-5bae-9099-e58579fa3638 with identifier: UU36082
2026-03-30 09:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a00ecdb4-58b4-5bae-9099-e58579fa3638 with scrape type 2
2026-03-30 09:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a00ecdb4-58b4-5bae-9099-e58579fa3638 with scrape type 2
2026-03-30 09:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a00ecdb4-58b4-5bae-9099-e58579fa3638, identifier: UU36082
2026-03-30 09:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY85045> (referer: https://www.auto1.com/v1/car-details-view/XY85045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_ea83a6dc092f197733916b8748b40b20.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_6afa8b815d3a18fcc400c9ab128ed2a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:25 [auto1.it] INFO: Found listing with ID: GV68046
2026-03-30 09:11:25 [auto1.it] INFO: Found listing with ID: AM83523
2026-03-30 09:11:25 [auto1.it] INFO: Found listing with ID: PL36367
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL36367%27 HTTP/1.1" 200 None
2026-03-30 09:11:25 [auto1.it] INFO: Scrape type for PL36367: 2
2026-03-30 09:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99397eee-c1af-5e2f-bf55-c19ee3261784 with identifier: PL36367
2026-03-30 09:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99397eee-c1af-5e2f-bf55-c19ee3261784 with scrape type 2
2026-03-30 09:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99397eee-c1af-5e2f-bf55-c19ee3261784 with scrape type 2
2026-03-30 09:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 99397eee-c1af-5e2f-bf55-c19ee3261784, identifier: PL36367
2026-03-30 09:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a00ecdb4-58b4-5bae-9099-e58579fa3638 with identifier: UU36082
2026-03-30 09:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a00ecdb4-58b4-5bae-9099-e58579fa3638 with identifier: UU36082
2026-03-30 09:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a00ecdb4-58b4-5bae-9099-e58579fa3638 with identifier: UU36082 to the API
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:39:53Z',
 'fuel_type': 'petrol',
 'id': 'a00ecdb4-58b4-5bae-9099-e58579fa3638',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU36082',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'New Beetle',
 'odometer': 178587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-11-10',
 'seller_name': None,
 'title': 'Volkswagen New Beetle 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU36082%27 HTTP/1.1" 200 None
2026-03-30 09:11:25 [auto1.it] INFO: Saving data for UU36082: {'auction_closing_time': 1774885193.0, 'created_time': 1774645809.947302, 'last_price_update_time': 1774861885.399844}
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UU36082') HTTP/1.1" 204 0
2026-03-30 09:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee24ac790>
2026-03-30 09:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_e1c193f450d19c7f51ae94754b08e95c.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_e1c193f450d19c7f51ae94754b08e95c.jpg saved to cache
2026-03-30 09:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-03-30 09:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee130f5d0>
2026-03-30 09:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04eda6bc-9bb0-5360-a107-466353a9cd1c/04eda6bc-9bb0-5360-a107-466353a9cd1c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa2%252F50a224ede647473dcb61051a087f8b43%252Fpa%252FYP88006_003ec9f4e3a78eb60f9f464c61f1549c.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_003ec9f4e3a78eb60f9f464c61f1549c.jpg saved to cache
2026-03-30 09:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04eda6bc-9bb0-5360-a107-466353a9cd1c
2026-03-30 09:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_30c4188a6a59874406e34f560e4ebec7.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 99397eee-c1af-5e2f-bf55-c19ee3261784 with identifier: PL36367
2026-03-30 09:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 99397eee-c1af-5e2f-bf55-c19ee3261784 with identifier: PL36367
2026-03-30 09:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 99397eee-c1af-5e2f-bf55-c19ee3261784 with identifier: PL36367 to the API
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:52Z',
 'fuel_type': 'diesel',
 'id': '99397eee-c1af-5e2f-bf55-c19ee3261784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL36367',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 60034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL36367%27 HTTP/1.1" 200 None
2026-03-30 09:11:25 [auto1.it] INFO: Saving data for PL36367: {'auction_closing_time': 1774883872.0, 'created_time': 1774775155.541639, 'last_price_update_time': 1774861885.836042}
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PL36367') HTTP/1.1" 204 0
2026-03-30 09:11:25 [auto1.it] INFO: Found listing with ID: TZ72536
2026-03-30 09:11:25 [auto1.it] INFO: Found listing with ID: UF95553
2026-03-30 09:11:25 [auto1.it] INFO: Found listing with ID: VB04552
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04552%27 HTTP/1.1" 200 None
2026-03-30 09:11:25 [auto1.it] INFO: Scrape type for VB04552: 2
2026-03-30 09:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65755d90-350c-5eed-811e-5c405af37e60 with identifier: VB04552
2026-03-30 09:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65755d90-350c-5eed-811e-5c405af37e60 with scrape type 2
2026-03-30 09:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65755d90-350c-5eed-811e-5c405af37e60 with scrape type 2
2026-03-30 09:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 65755d90-350c-5eed-811e-5c405af37e60, identifier: VB04552
2026-03-30 09:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_407abe2cc8ad36dc9a0f4359722e5a36.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:25 [auto1.it] INFO: Found listing with ID: FD72326
2026-03-30 09:11:25 [auto1.it] INFO: Found listing with ID: EZ36845
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ36845%27 HTTP/1.1" 200 None
2026-03-30 09:11:25 [auto1.it] INFO: Scrape type for EZ36845: 2
2026-03-30 09:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa5f3677-61e4-5769-bebb-18c82859f7a6 with identifier: EZ36845
2026-03-30 09:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa5f3677-61e4-5769-bebb-18c82859f7a6 with scrape type 2
2026-03-30 09:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa5f3677-61e4-5769-bebb-18c82859f7a6 with scrape type 2
2026-03-30 09:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa5f3677-61e4-5769-bebb-18c82859f7a6, identifier: EZ36845
2026-03-30 09:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 65755d90-350c-5eed-811e-5c405af37e60 with identifier: VB04552
2026-03-30 09:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 65755d90-350c-5eed-811e-5c405af37e60 with identifier: VB04552
2026-03-30 09:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 65755d90-350c-5eed-811e-5c405af37e60 with identifier: VB04552 to the API
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:42:11Z',
 'fuel_type': 'petrol',
 'id': '65755d90-350c-5eed-811e-5c405af37e60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB04552',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 41260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-05',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Si4 TwinTurbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04552%27 HTTP/1.1" 200 None
2026-03-30 09:11:26 [auto1.it] INFO: Saving data for VB04552: {'auction_closing_time': 1774885331.0, 'created_time': 1773132074.506033, 'last_price_update_time': 1774861886.357055}
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VB04552') HTTP/1.1" 204 0
2026-03-30 09:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_26baa594d49d7439b39c1a9c2ecf7a97.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa5f3677-61e4-5769-bebb-18c82859f7a6 with identifier: EZ36845
2026-03-30 09:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa5f3677-61e4-5769-bebb-18c82859f7a6 with identifier: EZ36845
2026-03-30 09:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa5f3677-61e4-5769-bebb-18c82859f7a6 with identifier: EZ36845 to the API
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:37:20Z',
 'fuel_type': 'diesel',
 'id': 'fa5f3677-61e4-5769-bebb-18c82859f7a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ36845',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 278995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-17',
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ36845%27 HTTP/1.1" 200 None
2026-03-30 09:11:26 [auto1.it] INFO: Saving data for EZ36845: {'auction_closing_time': 1774885040.0, 'created_time': 1774645813.316885, 'last_price_update_time': 1774861886.768253}
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ36845') HTTP/1.1" 204 0
2026-03-30 09:11:26 [auto1.it] INFO: Found listing with ID: AR75288
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR75288%27 HTTP/1.1" 200 None
2026-03-30 09:11:26 [auto1.it] INFO: Scrape type for AR75288: 2
2026-03-30 09:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288
2026-03-30 09:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1c94059-c0dc-5c7b-b872-9af3291319e9 with scrape type 2
2026-03-30 09:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1c94059-c0dc-5c7b-b872-9af3291319e9 with scrape type 2
2026-03-30 09:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1c94059-c0dc-5c7b-b872-9af3291319e9, identifier: AR75288
2026-03-30 09:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1152a10>
2026-03-30 09:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_8b0d33cd50f9bc83de049a778e6bf2ed.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8b0d33cd50f9bc83de049a778e6bf2ed.jpg saved to cache
2026-03-30 09:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-03-30 09:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee26ec1d0>
2026-03-30 09:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_2a9f9327f19dff4db218f8132409d1da.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_2a9f9327f19dff4db218f8132409d1da.jpg saved to cache
2026-03-30 09:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c554bb5-b057-521f-b650-242ef5e471bb
2026-03-30 09:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277 with identifier: XY85045
2026-03-30 09:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277 with scrape type 1
2026-03-30 09:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F46%252F9346dc8742db25e6503279d276734f3c%252Fpa%252FXY85045_8df2f954e5c3c9ef5a09add681024081.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_8df2f954e5c3c9ef5a09add681024081.jpg already downloaded
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F46%252F9346dc8742db25e6503279d276734f3c%252Fpa%252FXY85045_2d52d5fc69e89556b19139c936b68922.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_2d52d5fc69e89556b19139c936b68922.jpg already downloaded
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F46%252F9346dc8742db25e6503279d276734f3c%252Fpa%252FXY85045_babedc8f4aac93d99ddafdc2077ade9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_babedc8f4aac93d99ddafdc2077ade9c.jpg already downloaded
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F46%252F9346dc8742db25e6503279d276734f3c%252Fpa%252FXY85045_17d5b9f48ff012c9fc81d6bafd1dff34.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_17d5b9f48ff012c9fc81d6bafd1dff34.jpg already downloaded
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F46%252F9346dc8742db25e6503279d276734f3c%252Fpa%252FXY85045_414ec25da8b04fce0ed542189bf75f8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_414ec25da8b04fce0ed542189bf75f8d.jpg already downloaded
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F46%252F9346dc8742db25e6503279d276734f3c%252Fpa%252FXY85045_c9c8deffa8114b62b59d4aace214fa71.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_c9c8deffa8114b62b59d4aace214fa71.jpg already downloaded
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F46%252F9346dc8742db25e6503279d276734f3c%252Fpa%252FXY85045_478b35795e348b156f8de305e00d600c.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_478b35795e348b156f8de305e00d600c.jpg already downloaded
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F46%252F9346dc8742db25e6503279d276734f3c%252Fpa%252FXY85045_1e760b2d39ba1d0f30e748c97bad0d87.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_1e760b2d39ba1d0f30e748c97bad0d87.jpg already downloaded
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F46%252F9346dc8742db25e6503279d276734f3c%252Fpa%252FXY85045_0531f85d31c3a24949795cc11fc280ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_0531f85d31c3a24949795cc11fc280ea.jpg already downloaded
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F46%252F9346dc8742db25e6503279d276734f3c%252Fpa%252FXY85045_197b035cdf4d7cb977a585507887b326.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_197b035cdf4d7cb977a585507887b326.jpg already downloaded
2026-03-30 09:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277, identifier: XY85045
2026-03-30 09:11:27 [auto1.it] INFO: Channel: 24h | Page: 26 | totalHits: 3312 | hits on page: 40
2026-03-30 09:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee108d050>
2026-03-30 09:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_ea83a6dc092f197733916b8748b40b20.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_ea83a6dc092f197733916b8748b40b20.jpg saved to cache
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c554bb5-b057-521f-b650-242ef5e471bb
2026-03-30 09:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee4ac56d0>
2026-03-30 09:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_6afa8b815d3a18fcc400c9ab128ed2a0.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_6afa8b815d3a18fcc400c9ab128ed2a0.jpg saved to cache
2026-03-30 09:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-03-30 09:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96d860c88bd7bc878a0981a57c32070b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:27 [auto1.it] INFO: Found listing with ID: ES96291
2026-03-30 09:11:27 [auto1.it] INFO: Found listing with ID: DJ07683
2026-03-30 09:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288
2026-03-30 09:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288
2026-03-30 09:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1c94059-c0dc-5c7b-b872-9af3291319e9 with identifier: AR75288 to the API
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:35:39Z',
 'fuel_type': 'petrol',
 'id': 'a1c94059-c0dc-5c7b-b872-9af3291319e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR75288',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 15433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-19',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Mild-Hybrid Techno',
 'transmission': 'manual',
 'trim': 'Techno',
 'year': 2023}
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR75288%27 HTTP/1.1" 200 None
2026-03-30 09:11:27 [auto1.it] INFO: Saving data for AR75288: {'auction_closing_time': 1774884939.0, 'created_time': 1771448166.480277, 'last_price_update_time': 1774861887.745599}
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR75288') HTTP/1.1" 204 0
2026-03-30 09:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277 with identifier: XY85045
2026-03-30 09:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277 with identifier: XY85045
2026-03-30 09:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277 with identifier: XY85045 to the API
2026-03-30 09:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XY85045>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:18:46Z',
 'fuel_type': 'diesel',
 'id': 'a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY85045',
 'listing': 'auction',
 'location': 'Fasano BR',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 151702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_8df2f954e5c3c9ef5a09add681024081.jpg',
                'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_2d52d5fc69e89556b19139c936b68922.jpg',
                'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_babedc8f4aac93d99ddafdc2077ade9c.jpg',
                'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_17d5b9f48ff012c9fc81d6bafd1dff34.jpg',
                'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_414ec25da8b04fce0ed542189bf75f8d.jpg',
                'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_c9c8deffa8114b62b59d4aace214fa71.jpg',
                'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_478b35795e348b156f8de305e00d600c.jpg',
                'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_1e760b2d39ba1d0f30e748c97bad0d87.jpg',
                'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_0531f85d31c3a24949795cc11fc280ea.jpg',
                'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_197b035cdf4d7cb977a585507887b326.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277/a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_8df2f954e5c3c9ef5a09add681024081.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277/a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_2d52d5fc69e89556b19139c936b68922.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277/a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_babedc8f4aac93d99ddafdc2077ade9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277/a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_17d5b9f48ff012c9fc81d6bafd1dff34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277/a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_414ec25da8b04fce0ed542189bf75f8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277/a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_c9c8deffa8114b62b59d4aace214fa71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277/a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_478b35795e348b156f8de305e00d600c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277/a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_1e760b2d39ba1d0f30e748c97bad0d87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277/a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_0531f85d31c3a24949795cc11fc280ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277/a1cf4989-5ed4-5f5d-acb9-3bbcf15c7277_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/46/9346dc8742db25e6503279d276734f3c/pa/XY85045_197b035cdf4d7cb977a585507887b326.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY85045%27 HTTP/1.1" 200 None
2026-03-30 09:11:28 [auto1.it] INFO: Saving data for XY85045: {'created_time': 1774861888.132387, 'last_price_update_time': 1774861888.132396, 'auction_closing_time': 1774970326.0}
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY85045') HTTP/1.1" 204 0
2026-03-30 09:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_faddf8b21b04456cc8ea3850caa0aae5.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: NV53187
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: LV27017
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: PW45536
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: CV60051
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: DX65690
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: LD05493
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD05493%27 HTTP/1.1" 200 None
2026-03-30 09:11:28 [auto1.it] INFO: Scrape type for LD05493: 2
2026-03-30 09:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82fb2007-17be-5584-b2ac-706cee069e38 with identifier: LD05493
2026-03-30 09:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82fb2007-17be-5584-b2ac-706cee069e38 with scrape type 2
2026-03-30 09:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82fb2007-17be-5584-b2ac-706cee069e38 with scrape type 2
2026-03-30 09:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82fb2007-17be-5584-b2ac-706cee069e38, identifier: LD05493
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: BT07540
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: GU21322
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: RF01908
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF01908%27 HTTP/1.1" 200 None
2026-03-30 09:11:28 [auto1.it] INFO: Scrape type for RF01908: 0
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: TD67992
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: AT20318
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: VD89462
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: MT35916
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: BN48518
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: NV82845
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: AL33371
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: CT54414
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: BP08183
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP08183%27 HTTP/1.1" 200 None
2026-03-30 09:11:28 [auto1.it] INFO: Scrape type for BP08183: 0
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: BN63914
2026-03-30 09:11:28 [auto1.it] INFO: Found listing with ID: HF95426
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF95426%27 HTTP/1.1" 200 None
2026-03-30 09:11:28 [auto1.it] INFO: Scrape type for HF95426: 2
2026-03-30 09:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25565771-b8e4-5fd1-9a22-8f47ae1fc17e with identifier: HF95426
2026-03-30 09:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25565771-b8e4-5fd1-9a22-8f47ae1fc17e with scrape type 2
2026-03-30 09:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25565771-b8e4-5fd1-9a22-8f47ae1fc17e with scrape type 2
2026-03-30 09:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25565771-b8e4-5fd1-9a22-8f47ae1fc17e, identifier: HF95426
2026-03-30 09:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82fb2007-17be-5584-b2ac-706cee069e38 with identifier: LD05493
2026-03-30 09:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82fb2007-17be-5584-b2ac-706cee069e38 with identifier: LD05493
2026-03-30 09:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82fb2007-17be-5584-b2ac-706cee069e38 with identifier: LD05493 to the API
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:54:42Z',
 'fuel_type': 'diesel',
 'id': '82fb2007-17be-5584-b2ac-706cee069e38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD05493',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 98904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-15',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 2.0 TD Sd4 SD4 SE',
 'transmission': 'automatic',
 'trim': 'SD4 SE',
 'year': 2021}
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD05493%27 HTTP/1.1" 200 None
2026-03-30 09:11:28 [auto1.it] INFO: Saving data for LD05493: {'auction_closing_time': 1774886082.0, 'created_time': 1773130368.129171, 'last_price_update_time': 1774861888.737107}
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD05493') HTTP/1.1" 204 0
2026-03-30 09:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25565771-b8e4-5fd1-9a22-8f47ae1fc17e with identifier: HF95426
2026-03-30 09:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25565771-b8e4-5fd1-9a22-8f47ae1fc17e with identifier: HF95426
2026-03-30 09:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 25565771-b8e4-5fd1-9a22-8f47ae1fc17e with identifier: HF95426 to the API
2026-03-30 09:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:29Z',
 'fuel_type': 'diesel',
 'id': '25565771-b8e4-5fd1-9a22-8f47ae1fc17e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF95426',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 186430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-29',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Xpossible ISG 2WD',
 'transmission': 'manual',
 'trim': 'Xpossible ISG 2WD',
 'year': 2017}
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF95426%27 HTTP/1.1" 200 None
2026-03-30 09:11:29 [auto1.it] INFO: Saving data for HF95426: {'auction_closing_time': 1774883129.0, 'created_time': 1772309589.40592, 'last_price_update_time': 1774861889.115564}
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HF95426') HTTP/1.1" 204 0
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2825d10>
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04eda6bc-9bb0-5360-a107-466353a9cd1c/04eda6bc-9bb0-5360-a107-466353a9cd1c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa2%252F50a224ede647473dcb61051a087f8b43%252Fpa%252FYP88006_30c4188a6a59874406e34f560e4ebec7.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_30c4188a6a59874406e34f560e4ebec7.jpg saved to cache
2026-03-30 09:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04eda6bc-9bb0-5360-a107-466353a9cd1c
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13fe110>
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04eda6bc-9bb0-5360-a107-466353a9cd1c/04eda6bc-9bb0-5360-a107-466353a9cd1c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa2%252F50a224ede647473dcb61051a087f8b43%252Fpa%252FYP88006_407abe2cc8ad36dc9a0f4359722e5a36.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_407abe2cc8ad36dc9a0f4359722e5a36.jpg saved to cache
2026-03-30 09:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04eda6bc-9bb0-5360-a107-466353a9cd1c
2026-03-30 09:11:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2601890>
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04eda6bc-9bb0-5360-a107-466353a9cd1c/04eda6bc-9bb0-5360-a107-466353a9cd1c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa2%252F50a224ede647473dcb61051a087f8b43%252Fpa%252FYP88006_26baa594d49d7439b39c1a9c2ecf7a97.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_26baa594d49d7439b39c1a9c2ecf7a97.jpg saved to cache
2026-03-30 09:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04eda6bc-9bb0-5360-a107-466353a9cd1c
2026-03-30 09:11:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04eda6bc-9bb0-5360-a107-466353a9cd1c, skipping ID generation
2026-03-30 09:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04eda6bc-9bb0-5360-a107-466353a9cd1c with scrape type 1
2026-03-30 09:11:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04eda6bc-9bb0-5360-a107-466353a9cd1c sending to next pipeline
2026-03-30 09:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 04eda6bc-9bb0-5360-a107-466353a9cd1c, identifier: YP88006
2026-03-30 09:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_3edcf53f98a45f3fcdaf27f9d93311f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_cda3054cacc042307dc4182163574a0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:29 [auto1.it] INFO: Found listing with ID: RN24419
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN24419%27 HTTP/1.1" 200 None
2026-03-30 09:11:29 [auto1.it] INFO: Scrape type for RN24419: 2
2026-03-30 09:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419
2026-03-30 09:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 752208e0-483a-5ac1-b162-e4c16b7ab71c with scrape type 2
2026-03-30 09:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 752208e0-483a-5ac1-b162-e4c16b7ab71c with scrape type 2
2026-03-30 09:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 752208e0-483a-5ac1-b162-e4c16b7ab71c, identifier: RN24419
2026-03-30 09:11:29 [auto1.it] INFO: Found listing with ID: HP00544
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP00544%27 HTTP/1.1" 200 None
2026-03-30 09:11:29 [auto1.it] INFO: Scrape type for HP00544: 2
2026-03-30 09:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1b9c253-86f5-51cd-bbda-26ed9d5a36e7 with identifier: HP00544
2026-03-30 09:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1b9c253-86f5-51cd-bbda-26ed9d5a36e7 with scrape type 2
2026-03-30 09:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1b9c253-86f5-51cd-bbda-26ed9d5a36e7 with scrape type 2
2026-03-30 09:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1b9c253-86f5-51cd-bbda-26ed9d5a36e7, identifier: HP00544
2026-03-30 09:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 04eda6bc-9bb0-5360-a107-466353a9cd1c with identifier: YP88006
2026-03-30 09:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 04eda6bc-9bb0-5360-a107-466353a9cd1c with identifier: YP88006
2026-03-30 09:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 04eda6bc-9bb0-5360-a107-466353a9cd1c with identifier: YP88006 to the API
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_26baa594d49d7439b39c1a9c2ecf7a97.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:20:34Z',
 'fuel_type': 'petrol',
 'id': '04eda6bc-9bb0-5360-a107-466353a9cd1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP88006',
 'listing': 'auction',
 'location': 'Navacchio',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 195905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04eda6bc-9bb0-5360-a107-466353a9cd1c/04eda6bc-9bb0-5360-a107-466353a9cd1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_558c6841f2752cc102ad0b9598b74cc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04eda6bc-9bb0-5360-a107-466353a9cd1c/04eda6bc-9bb0-5360-a107-466353a9cd1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_003ec9f4e3a78eb60f9f464c61f1549c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04eda6bc-9bb0-5360-a107-466353a9cd1c/04eda6bc-9bb0-5360-a107-466353a9cd1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_30c4188a6a59874406e34f560e4ebec7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04eda6bc-9bb0-5360-a107-466353a9cd1c/04eda6bc-9bb0-5360-a107-466353a9cd1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_26baa594d49d7439b39c1a9c2ecf7a97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04eda6bc-9bb0-5360-a107-466353a9cd1c/04eda6bc-9bb0-5360-a107-466353a9cd1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a2/50a224ede647473dcb61051a087f8b43/pa/YP88006_407abe2cc8ad36dc9a0f4359722e5a36.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Njoy',
 'transmission': 'manual',
 'trim': 'Njoy',
 'year': 2016}
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP88006%27 HTTP/1.1" 200 None
2026-03-30 09:11:29 [auto1.it] INFO: Saving data for YP88006: {'created_time': 1774861889.886671, 'last_price_update_time': 1774861889.886684, 'auction_closing_time': 1774970434.0}
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YP88006') HTTP/1.1" 204 0
2026-03-30 09:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419
2026-03-30 09:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419
2026-03-30 09:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 752208e0-483a-5ac1-b162-e4c16b7ab71c with identifier: RN24419 to the API
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:23:19Z',
 'fuel_type': 'diesel',
 'id': '752208e0-483a-5ac1-b162-e4c16b7ab71c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN24419',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 76562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.2 CRDi Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2019}
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN24419%27 HTTP/1.1" 200 None
2026-03-30 09:11:30 [auto1.it] INFO: Saving data for RN24419: {'auction_closing_time': 1774884199.0, 'created_time': 1771706434.628753, 'last_price_update_time': 1774861890.242392}
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RN24419') HTTP/1.1" 204 0
2026-03-30 09:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1b9c253-86f5-51cd-bbda-26ed9d5a36e7 with identifier: HP00544
2026-03-30 09:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1b9c253-86f5-51cd-bbda-26ed9d5a36e7 with identifier: HP00544
2026-03-30 09:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1b9c253-86f5-51cd-bbda-26ed9d5a36e7 with identifier: HP00544 to the API
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:15:23Z',
 'fuel_type': 'diesel',
 'id': 'a1b9c253-86f5-51cd-bbda-26ed9d5a36e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP00544',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 233070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-03',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2010}
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP00544%27 HTTP/1.1" 200 None
2026-03-30 09:11:30 [auto1.it] INFO: Saving data for HP00544: {'auction_closing_time': 1774883723.0, 'created_time': 1771448149.187355, 'last_price_update_time': 1774861890.517949}
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HP00544') HTTP/1.1" 204 0
2026-03-30 09:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee257d050>
2026-03-30 09:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_96d860c88bd7bc878a0981a57c32070b.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96d860c88bd7bc878a0981a57c32070b.jpg saved to cache
2026-03-30 09:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-03-30 09:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2606e50>
2026-03-30 09:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_faddf8b21b04456cc8ea3850caa0aae5.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_faddf8b21b04456cc8ea3850caa0aae5.jpg saved to cache
2026-03-30 09:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c554bb5-b057-521f-b650-242ef5e471bb
2026-03-30 09:11:30 [auto1.it] INFO: Found listing with ID: MP43347
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP43347%27 HTTP/1.1" 200 None
2026-03-30 09:11:30 [auto1.it] INFO: Scrape type for MP43347: 2
2026-03-30 09:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc8ad652-b79c-5432-8ae0-aadb44bd937e with identifier: MP43347
2026-03-30 09:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc8ad652-b79c-5432-8ae0-aadb44bd937e with scrape type 2
2026-03-30 09:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc8ad652-b79c-5432-8ae0-aadb44bd937e with scrape type 2
2026-03-30 09:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cc8ad652-b79c-5432-8ae0-aadb44bd937e, identifier: MP43347
2026-03-30 09:11:30 [auto1.it] INFO: Found listing with ID: BP79618
2026-03-30 09:11:30 [auto1.it] INFO: Found listing with ID: JM07675
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM07675%27 HTTP/1.1" 200 None
2026-03-30 09:11:30 [auto1.it] INFO: Scrape type for JM07675: 2
2026-03-30 09:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7dd439d-7335-5b2a-96ae-6bff217b977d with identifier: JM07675
2026-03-30 09:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7dd439d-7335-5b2a-96ae-6bff217b977d with scrape type 2
2026-03-30 09:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7dd439d-7335-5b2a-96ae-6bff217b977d with scrape type 2
2026-03-30 09:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7dd439d-7335-5b2a-96ae-6bff217b977d, identifier: JM07675
2026-03-30 09:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cc8ad652-b79c-5432-8ae0-aadb44bd937e with identifier: MP43347
2026-03-30 09:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cc8ad652-b79c-5432-8ae0-aadb44bd937e with identifier: MP43347
2026-03-30 09:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cc8ad652-b79c-5432-8ae0-aadb44bd937e with identifier: MP43347 to the API
2026-03-30 09:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:54:53Z',
 'fuel_type': 'diesel',
 'id': 'cc8ad652-b79c-5432-8ae0-aadb44bd937e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP43347',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 109289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-07',
 'seller_name': None,
 'title': 'Audi A4 Allroad 50 TDI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-30 09:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP43347%27 HTTP/1.1" 200 None
2026-03-30 09:11:31 [auto1.it] INFO: Saving data for MP43347: {'auction_closing_time': 1774886093.0, 'created_time': 1771704612.359005, 'last_price_update_time': 1774861891.599101}
2026-03-30 09:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MP43347') HTTP/1.1" 204 0
2026-03-30 09:11:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7dd439d-7335-5b2a-96ae-6bff217b977d with identifier: JM07675
2026-03-30 09:11:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7dd439d-7335-5b2a-96ae-6bff217b977d with identifier: JM07675
2026-03-30 09:11:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7dd439d-7335-5b2a-96ae-6bff217b977d with identifier: JM07675 to the API
2026-03-30 09:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:31:54Z',
 'fuel_type': 'petrol',
 'id': 'f7dd439d-7335-5b2a-96ae-6bff217b977d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM07675',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 133032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-06',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM07675%27 HTTP/1.1" 200 None
2026-03-30 09:11:32 [auto1.it] INFO: Saving data for JM07675: {'auction_closing_time': 1774884714.0, 'created_time': 1772178123.235609, 'last_price_update_time': 1774861892.157642}
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JM07675') HTTP/1.1" 204 0
2026-03-30 09:11:32 [auto1.it] INFO: Found listing with ID: GM98091
2026-03-30 09:11:32 [auto1.it] INFO: Found listing with ID: FZ84197
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ84197%27 HTTP/1.1" 200 None
2026-03-30 09:11:32 [auto1.it] INFO: Scrape type for FZ84197: 2
2026-03-30 09:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b3b217-593c-5b7d-9265-66a70b612a1c with identifier: FZ84197
2026-03-30 09:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b3b217-593c-5b7d-9265-66a70b612a1c with scrape type 2
2026-03-30 09:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22b3b217-593c-5b7d-9265-66a70b612a1c with scrape type 2
2026-03-30 09:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 22b3b217-593c-5b7d-9265-66a70b612a1c, identifier: FZ84197
2026-03-30 09:11:32 [auto1.it] INFO: Found listing with ID: RH51266
2026-03-30 09:11:32 [auto1.it] INFO: Found listing with ID: WX96902
2026-03-30 09:11:32 [auto1.it] INFO: Found listing with ID: PY07878
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY07878%27 HTTP/1.1" 200 None
2026-03-30 09:11:32 [auto1.it] INFO: Scrape type for PY07878: 0
2026-03-30 09:11:32 [auto1.it] INFO: Found listing with ID: KZ05620
2026-03-30 09:11:32 [auto1.it] INFO: Found listing with ID: NU85167
2026-03-30 09:11:32 [auto1.it] INFO: Found listing with ID: YG23649
2026-03-30 09:11:32 [auto1.it] INFO: Found listing with ID: ML72062
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML72062%27 HTTP/1.1" 200 None
2026-03-30 09:11:32 [auto1.it] INFO: Scrape type for ML72062: 2
2026-03-30 09:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcd545a8-cb37-5f45-b987-e22f6a9ede52 with identifier: ML72062
2026-03-30 09:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd545a8-cb37-5f45-b987-e22f6a9ede52 with scrape type 2
2026-03-30 09:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcd545a8-cb37-5f45-b987-e22f6a9ede52 with scrape type 2
2026-03-30 09:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fcd545a8-cb37-5f45-b987-e22f6a9ede52, identifier: ML72062
2026-03-30 09:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY71538> (referer: https://www.auto1.com/v1/car-details-view/SY71538/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2734a50>
2026-03-30 09:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_3edcf53f98a45f3fcdaf27f9d93311f3.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_3edcf53f98a45f3fcdaf27f9d93311f3.jpg saved to cache
2026-03-30 09:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-03-30 09:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1469750>
2026-03-30 09:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_cda3054cacc042307dc4182163574a0a.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_cda3054cacc042307dc4182163574a0a.jpg saved to cache
2026-03-30 09:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-03-30 09:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 22b3b217-593c-5b7d-9265-66a70b612a1c with identifier: FZ84197
2026-03-30 09:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 22b3b217-593c-5b7d-9265-66a70b612a1c with identifier: FZ84197
2026-03-30 09:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 22b3b217-593c-5b7d-9265-66a70b612a1c with identifier: FZ84197 to the API
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:31:58Z',
 'fuel_type': 'diesel',
 'id': '22b3b217-593c-5b7d-9265-66a70b612a1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ84197',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 87237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-30',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.8 CRD Rubicon',
 'transmission': 'automatic',
 'trim': 'Rubicon',
 'year': 2014}
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ84197%27 HTTP/1.1" 200 None
2026-03-30 09:11:32 [auto1.it] INFO: Saving data for FZ84197: {'auction_closing_time': 1774884718.0, 'created_time': 1772087936.890161, 'last_price_update_time': 1774861892.796936}
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FZ84197') HTTP/1.1" 204 0
2026-03-30 09:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fcd545a8-cb37-5f45-b987-e22f6a9ede52 with identifier: ML72062
2026-03-30 09:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fcd545a8-cb37-5f45-b987-e22f6a9ede52 with identifier: ML72062
2026-03-30 09:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fcd545a8-cb37-5f45-b987-e22f6a9ede52 with identifier: ML72062 to the API
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:02Z',
 'fuel_type': 'petrol',
 'id': 'fcd545a8-cb37-5f45-b987-e22f6a9ede52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML72062',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 40699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2022}
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML72062%27 HTTP/1.1" 200 None
2026-03-30 09:11:33 [auto1.it] INFO: Saving data for ML72062: {'auction_closing_time': 1774884962.0, 'created_time': 1774775185.151067, 'last_price_update_time': 1774861893.439696}
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ML72062') HTTP/1.1" 204 0
2026-03-30 09:11:33 [auto1.it] INFO: Found listing with ID: DD33299
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD33299%27 HTTP/1.1" 200 None
2026-03-30 09:11:33 [auto1.it] INFO: Scrape type for DD33299: 2
2026-03-30 09:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a7a01b4-ed3b-5290-86dd-0a97ff7c5253 with identifier: DD33299
2026-03-30 09:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a7a01b4-ed3b-5290-86dd-0a97ff7c5253 with scrape type 2
2026-03-30 09:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a7a01b4-ed3b-5290-86dd-0a97ff7c5253 with scrape type 2
2026-03-30 09:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0a7a01b4-ed3b-5290-86dd-0a97ff7c5253, identifier: DD33299
2026-03-30 09:11:33 [auto1.it] INFO: Found listing with ID: VC28082
2026-03-30 09:11:33 [auto1.it] INFO: Found listing with ID: ZP66852
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP66852%27 HTTP/1.1" 200 None
2026-03-30 09:11:33 [auto1.it] INFO: Scrape type for ZP66852: 0
2026-03-30 09:11:33 [auto1.it] INFO: Found listing with ID: EC11217
2026-03-30 09:11:33 [auto1.it] INFO: Found listing with ID: WT09600
2026-03-30 09:11:33 [auto1.it] INFO: Found listing with ID: VK05865
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK05865%27 HTTP/1.1" 200 None
2026-03-30 09:11:33 [auto1.it] INFO: Scrape type for VK05865: 2
2026-03-30 09:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e2825db-ab38-5be1-8550-99f68c11eaef with identifier: VK05865
2026-03-30 09:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e2825db-ab38-5be1-8550-99f68c11eaef with scrape type 2
2026-03-30 09:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e2825db-ab38-5be1-8550-99f68c11eaef with scrape type 2
2026-03-30 09:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e2825db-ab38-5be1-8550-99f68c11eaef, identifier: VK05865
2026-03-30 09:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0a7a01b4-ed3b-5290-86dd-0a97ff7c5253 with identifier: DD33299
2026-03-30 09:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0a7a01b4-ed3b-5290-86dd-0a97ff7c5253 with identifier: DD33299
2026-03-30 09:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0a7a01b4-ed3b-5290-86dd-0a97ff7c5253 with identifier: DD33299 to the API
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:37:26Z',
 'fuel_type': 'diesel',
 'id': '0a7a01b4-ed3b-5290-86dd-0a97ff7c5253',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD33299',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 93216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-16',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2018}
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD33299%27 HTTP/1.1" 200 None
2026-03-30 09:11:33 [auto1.it] INFO: Saving data for DD33299: {'auction_closing_time': 1774885046.0, 'created_time': 1774775186.690771, 'last_price_update_time': 1774861893.973069}
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DD33299') HTTP/1.1" 204 0
2026-03-30 09:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e2825db-ab38-5be1-8550-99f68c11eaef with identifier: VK05865
2026-03-30 09:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e2825db-ab38-5be1-8550-99f68c11eaef with identifier: VK05865
2026-03-30 09:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e2825db-ab38-5be1-8550-99f68c11eaef with identifier: VK05865 to the API
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:24:08Z',
 'fuel_type': 'diesel',
 'id': '2e2825db-ab38-5be1-8550-99f68c11eaef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK05865',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Terrano',
 'odometer': 126955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-04-03',
 'seller_name': None,
 'title': 'Nissan Terrano 2.7 Turbodiesel Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2001}
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK05865%27 HTTP/1.1" 200 None
2026-03-30 09:11:34 [auto1.it] INFO: Saving data for VK05865: {'auction_closing_time': 1774884248.0, 'created_time': 1772177459.90896, 'last_price_update_time': 1774861894.284414}
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VK05865') HTTP/1.1" 204 0
2026-03-30 09:11:34 [auto1.it] INFO: Found listing with ID: YL53737
2026-03-30 09:11:34 [auto1.it] INFO: Found listing with ID: TH12767
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12767%27 HTTP/1.1" 200 None
2026-03-30 09:11:34 [auto1.it] INFO: Scrape type for TH12767: 2
2026-03-30 09:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 129b9f54-4a70-524b-9f3d-d8dd6c329d3b with identifier: TH12767
2026-03-30 09:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 129b9f54-4a70-524b-9f3d-d8dd6c329d3b with scrape type 2
2026-03-30 09:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 129b9f54-4a70-524b-9f3d-d8dd6c329d3b with scrape type 2
2026-03-30 09:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 129b9f54-4a70-524b-9f3d-d8dd6c329d3b, identifier: TH12767
2026-03-30 09:11:34 [auto1.it] INFO: Found listing with ID: NB08226
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB08226%27 HTTP/1.1" 200 None
2026-03-30 09:11:34 [auto1.it] INFO: Scrape type for NB08226: 0
2026-03-30 09:11:34 [auto1.it] INFO: Found listing with ID: MA64070
2026-03-30 09:11:34 [auto1.it] INFO: Found listing with ID: LD57265
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-03-30 09:11:34 [auto1.it] INFO: Scrape type for LD57265: 2
2026-03-30 09:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265
2026-03-30 09:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with scrape type 2
2026-03-30 09:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with scrape type 2
2026-03-30 09:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 00bfeec1-6ca8-517a-8a76-c405df2aeb12, identifier: LD57265
2026-03-30 09:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 129b9f54-4a70-524b-9f3d-d8dd6c329d3b with identifier: TH12767
2026-03-30 09:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 129b9f54-4a70-524b-9f3d-d8dd6c329d3b with identifier: TH12767
2026-03-30 09:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 129b9f54-4a70-524b-9f3d-d8dd6c329d3b with identifier: TH12767 to the API
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:01:28Z',
 'fuel_type': 'petrol',
 'id': '129b9f54-4a70-524b-9f3d-d8dd6c329d3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH12767',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 117786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seller_name': None,
 'title': 'Jaguar XE 30t R-Dynamic SE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE AWD',
 'year': 2019}
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12767%27 HTTP/1.1" 200 None
2026-03-30 09:11:34 [auto1.it] INFO: Saving data for TH12767: {'auction_closing_time': 1774882888.0, 'created_time': 1773130596.857393, 'last_price_update_time': 1774861894.846576}
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH12767') HTTP/1.1" 204 0
2026-03-30 09:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265
2026-03-30 09:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265
2026-03-30 09:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 00bfeec1-6ca8-517a-8a76-c405df2aeb12 with identifier: LD57265 to the API
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:08:51Z',
 'fuel_type': 'diesel',
 'id': '00bfeec1-6ca8-517a-8a76-c405df2aeb12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD57265',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 143043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-25',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2021}
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-03-30 09:11:35 [auto1.it] INFO: Saving data for LD57265: {'auction_closing_time': 1774883331.0, 'created_time': 1773130055.5601, 'last_price_update_time': 1774861895.260026}
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD57265') HTTP/1.1" 204 0
2026-03-30 09:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd396392-94b9-52e5-a20c-5d1c233d2e75 with identifier: SY71538
2026-03-30 09:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd396392-94b9-52e5-a20c-5d1c233d2e75 with scrape type 1
2026-03-30 09:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd396392-94b9-52e5-a20c-5d1c233d2e75
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_5b4ee02aca75d7765985ca795b20c173.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5b4ee02aca75d7765985ca795b20c173.jpg not downloaded yet
2026-03-30 09:11:35 [auto1.it] INFO: Found listing with ID: YY06074
2026-03-30 09:11:35 [auto1.it] INFO: Found listing with ID: BT07540
2026-03-30 09:11:35 [auto1.it] INFO: Found listing with ID: SU00968
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU00968%27 HTTP/1.1" 200 None
2026-03-30 09:11:35 [auto1.it] INFO: Scrape type for SU00968: 2
2026-03-30 09:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7de09e4f-9128-5866-98bd-d01b437a562c with identifier: SU00968
2026-03-30 09:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7de09e4f-9128-5866-98bd-d01b437a562c with scrape type 2
2026-03-30 09:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7de09e4f-9128-5866-98bd-d01b437a562c with scrape type 2
2026-03-30 09:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7de09e4f-9128-5866-98bd-d01b437a562c, identifier: SU00968
2026-03-30 09:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7de09e4f-9128-5866-98bd-d01b437a562c with identifier: SU00968
2026-03-30 09:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7de09e4f-9128-5866-98bd-d01b437a562c with identifier: SU00968
2026-03-30 09:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7de09e4f-9128-5866-98bd-d01b437a562c with identifier: SU00968 to the API
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:24:57Z',
 'fuel_type': 'diesel',
 'id': '7de09e4f-9128-5866-98bd-d01b437a562c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU00968',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 8904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2022}
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU00968%27 HTTP/1.1" 200 None
2026-03-30 09:11:35 [auto1.it] INFO: Saving data for SU00968: {'auction_closing_time': 1774884297.0, 'created_time': 1772265698.673289, 'last_price_update_time': 1774861895.705762}
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SU00968') HTTP/1.1" 204 0
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_aa6b7a3fcea72f593876f6d9a6703519.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_aa6b7a3fcea72f593876f6d9a6703519.jpg not downloaded yet
2026-03-30 09:11:35 [auto1.it] INFO: Found listing with ID: LC40122
2026-03-30 09:11:35 [auto1.it] INFO: Found listing with ID: AY64399
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY64399%27 HTTP/1.1" 200 None
2026-03-30 09:11:35 [auto1.it] INFO: Scrape type for AY64399: 2
2026-03-30 09:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82ead6e3-54a0-5d96-a284-b7a52c0b2665 with identifier: AY64399
2026-03-30 09:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82ead6e3-54a0-5d96-a284-b7a52c0b2665 with scrape type 2
2026-03-30 09:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82ead6e3-54a0-5d96-a284-b7a52c0b2665 with scrape type 2
2026-03-30 09:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82ead6e3-54a0-5d96-a284-b7a52c0b2665, identifier: AY64399
2026-03-30 09:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82ead6e3-54a0-5d96-a284-b7a52c0b2665 with identifier: AY64399
2026-03-30 09:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82ead6e3-54a0-5d96-a284-b7a52c0b2665 with identifier: AY64399
2026-03-30 09:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82ead6e3-54a0-5d96-a284-b7a52c0b2665 with identifier: AY64399 to the API
2026-03-30 09:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:21:41Z',
 'fuel_type': 'diesel',
 'id': '82ead6e3-54a0-5d96-a284-b7a52c0b2665',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY64399',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 129383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-27',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 M-Jet Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2016}
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY64399%27 HTTP/1.1" 200 None
2026-03-30 09:11:36 [auto1.it] INFO: Saving data for AY64399: {'auction_closing_time': 1774884101.0, 'created_time': 1772178628.012532, 'last_price_update_time': 1774861896.157164}
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AY64399') HTTP/1.1" 204 0
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_5d54cd2241b9c7fa31cb5537823d7613.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5d54cd2241b9c7fa31cb5537823d7613.jpg not downloaded yet
2026-03-30 09:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:36 [auto1.it] INFO: Found listing with ID: SV45287
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV45287%27 HTTP/1.1" 200 None
2026-03-30 09:11:36 [auto1.it] INFO: Scrape type for SV45287: 2
2026-03-30 09:11:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52ec4529-4307-59b2-80e1-36c0440c9038 with identifier: SV45287
2026-03-30 09:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52ec4529-4307-59b2-80e1-36c0440c9038 with scrape type 2
2026-03-30 09:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52ec4529-4307-59b2-80e1-36c0440c9038 with scrape type 2
2026-03-30 09:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 52ec4529-4307-59b2-80e1-36c0440c9038, identifier: SV45287
2026-03-30 09:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 52ec4529-4307-59b2-80e1-36c0440c9038 with identifier: SV45287
2026-03-30 09:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 52ec4529-4307-59b2-80e1-36c0440c9038 with identifier: SV45287
2026-03-30 09:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 52ec4529-4307-59b2-80e1-36c0440c9038 with identifier: SV45287 to the API
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:10Z',
 'fuel_type': 'diesel',
 'id': '52ec4529-4307-59b2-80e1-36c0440c9038',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV45287',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 187012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-17',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2018}
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV45287%27 HTTP/1.1" 200 None
2026-03-30 09:11:36 [auto1.it] INFO: Saving data for SV45287: {'auction_closing_time': 1774885810.0, 'created_time': 1771706421.57277, 'last_price_update_time': 1774861896.580841}
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SV45287') HTTP/1.1" 204 0
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_91ca767211064bee80757492f2d6d4eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_91ca767211064bee80757492f2d6d4eb.jpg not downloaded yet
2026-03-30 09:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5b4ee02aca75d7765985ca795b20c173.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:36 [auto1.it] INFO: Found listing with ID: YH31345
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH31345%27 HTTP/1.1" 200 None
2026-03-30 09:11:36 [auto1.it] INFO: Scrape type for YH31345: 0
2026-03-30 09:11:36 [auto1.it] INFO: Found listing with ID: WR22265
2026-03-30 09:11:36 [auto1.it] INFO: Found listing with ID: RL06920
2026-03-30 09:11:36 [auto1.it] INFO: Found listing with ID: YT62048
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT62048%27 HTTP/1.1" 200 None
2026-03-30 09:11:36 [auto1.it] INFO: Scrape type for YT62048: 2
2026-03-30 09:11:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3e71ed9-b550-597d-b82f-9f74caedd91d with identifier: YT62048
2026-03-30 09:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3e71ed9-b550-597d-b82f-9f74caedd91d with scrape type 2
2026-03-30 09:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3e71ed9-b550-597d-b82f-9f74caedd91d with scrape type 2
2026-03-30 09:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3e71ed9-b550-597d-b82f-9f74caedd91d, identifier: YT62048
2026-03-30 09:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3e71ed9-b550-597d-b82f-9f74caedd91d with identifier: YT62048
2026-03-30 09:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3e71ed9-b550-597d-b82f-9f74caedd91d with identifier: YT62048
2026-03-30 09:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3e71ed9-b550-597d-b82f-9f74caedd91d with identifier: YT62048 to the API
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:56:34Z',
 'fuel_type': 'petrol',
 'id': 'e3e71ed9-b550-597d-b82f-9f74caedd91d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT62048',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 86699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-23',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 Ego ecoFlex',
 'transmission': 'manual',
 'trim': 'Ego ecoFlex',
 'year': 2016}
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT62048%27 HTTP/1.1" 200 None
2026-03-30 09:11:37 [auto1.it] INFO: Saving data for YT62048: {'auction_closing_time': 1774886194.0, 'created_time': 1772265712.950759, 'last_price_update_time': 1774861897.014209}
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YT62048') HTTP/1.1" 204 0
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_40f9097920db8896bbabd10ece2c69eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_40f9097920db8896bbabd10ece2c69eb.jpg not downloaded yet
2026-03-30 09:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_aa6b7a3fcea72f593876f6d9a6703519.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee119b2d0>
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F26%252F742675c8d7c26f9686ba8305a440a650%252Fpa%252FAA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg saved to cache
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-03-30 09:11:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d269d9d-7d8c-5312-9b48-2d559ebdf045, skipping ID generation
2026-03-30 09:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with scrape type 1
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045 sending to next pipeline
2026-03-30 09:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d269d9d-7d8c-5312-9b48-2d559ebdf045, identifier: AA15878
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_7a85527e1e53997ae977d6d130d227ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_7a85527e1e53997ae977d6d130d227ea.jpg not downloaded yet
2026-03-30 09:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with identifier: AA15878
2026-03-30 09:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with identifier: AA15878
2026-03-30 09:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with identifier: AA15878 to the API
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.3L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:34:13Z',
 'fuel_type': 'diesel',
 'id': '9d269d9d-7d8c-5312-9b48-2d559ebdf045',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA15878',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 102381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2226713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96e3201c7d67c22c55f2bd0d226cf98d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_7b670973900c0639cc41e06023e1f2c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_ae50c2c0b42001b7182b55ef8a4b3805.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_e1c193f450d19c7f51ae94754b08e95c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8b0d33cd50f9bc83de049a778e6bf2ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_6afa8b815d3a18fcc400c9ab128ed2a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96d860c88bd7bc878a0981a57c32070b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_cda3054cacc042307dc4182163574a0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_3edcf53f98a45f3fcdaf27f9d93311f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Insport ClearTec 2WD',
 'transmission': 'manual',
 'trim': 'Insport ClearTec 2WD',
 'year': 2017}
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA15878%27 HTTP/1.1" 200 None
2026-03-30 09:11:37 [auto1.it] INFO: Saving data for AA15878: {'created_time': 1774861897.649324, 'last_price_update_time': 1774861897.649336, 'auction_closing_time': 1774971253.0}
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AA15878') HTTP/1.1" 204 0
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee4eec0d0>
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_0.jpg HTTP/1.1" 201 0
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_5b4ee02aca75d7765985ca795b20c173.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5b4ee02aca75d7765985ca795b20c173.jpg saved to cache
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd396392-94b9-52e5-a20c-5d1c233d2e75
2026-03-30 09:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5d54cd2241b9c7fa31cb5537823d7613.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_b4a48c09d29d49323289c9c81eefa67f.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_b4a48c09d29d49323289c9c81eefa67f.jpg not downloaded yet
2026-03-30 09:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_91ca767211064bee80757492f2d6d4eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2679dd0>
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_1.jpg HTTP/1.1" 201 0
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_aa6b7a3fcea72f593876f6d9a6703519.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_aa6b7a3fcea72f593876f6d9a6703519.jpg saved to cache
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cd396392-94b9-52e5-a20c-5d1c233d2e75
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_5b2287de310fe897f5ed4ec9de55ae9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5b2287de310fe897f5ed4ec9de55ae9b.jpg not downloaded yet
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_11b16be0c9fdc09b6e60375ed09e9c05.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_11b16be0c9fdc09b6e60375ed09e9c05.jpg not downloaded yet
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee257d650>
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_5d54cd2241b9c7fa31cb5537823d7613.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5d54cd2241b9c7fa31cb5537823d7613.jpg saved to cache
2026-03-30 09:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd396392-94b9-52e5-a20c-5d1c233d2e75
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12d4f10>
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_3.jpg HTTP/1.1" 201 0
2026-03-30 09:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_91ca767211064bee80757492f2d6d4eb.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_91ca767211064bee80757492f2d6d4eb.jpg saved to cache
2026-03-30 09:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd396392-94b9-52e5-a20c-5d1c233d2e75
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_69184dd5303b1feae57fbb93dbfd1279.jpg%27 HTTP/1.1" 200 None
2026-03-30 09:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_69184dd5303b1feae57fbb93dbfd1279.jpg not downloaded yet
2026-03-30 09:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_40f9097920db8896bbabd10ece2c69eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_5aaa2745f7168647e4ed1b39b38c2fe0.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_73b3604599421bc21ae3d1bb04d42b82.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_682a476b35b7012381c27554f70ae52a.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_bf7e96003db69d118df5f705ce8ce512.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5b2287de310fe897f5ed4ec9de55ae9b.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_b4a48c09d29d49323289c9c81eefa67f.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_69184dd5303b1feae57fbb93dbfd1279.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:38 [auto1.it] INFO: Channel: 24h | Page: 27 | totalHits: 3312 | hits on page: 40
2026-03-30 09:11:38 [auto1.it] INFO: Found listing with ID: YL77268
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL77268%27 HTTP/1.1" 200 None
2026-03-30 09:11:38 [auto1.it] INFO: Scrape type for YL77268: 2
2026-03-30 09:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4e9fd87-6b6c-5089-95be-6ba01a231089 with identifier: YL77268
2026-03-30 09:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4e9fd87-6b6c-5089-95be-6ba01a231089 with scrape type 2
2026-03-30 09:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4e9fd87-6b6c-5089-95be-6ba01a231089 with scrape type 2
2026-03-30 09:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c4e9fd87-6b6c-5089-95be-6ba01a231089, identifier: YL77268
2026-03-30 09:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c4e9fd87-6b6c-5089-95be-6ba01a231089 with identifier: YL77268
2026-03-30 09:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c4e9fd87-6b6c-5089-95be-6ba01a231089 with identifier: YL77268
2026-03-30 09:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c4e9fd87-6b6c-5089-95be-6ba01a231089 with identifier: YL77268 to the API
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:31Z',
 'fuel_type': 'diesel',
 'id': 'c4e9fd87-6b6c-5089-95be-6ba01a231089',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL77268',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 55760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-15',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL77268%27 HTTP/1.1" 200 None
2026-03-30 09:11:38 [auto1.it] INFO: Saving data for YL77268: {'auction_closing_time': 1774884331.0, 'created_time': 1773134649.761772, 'last_price_update_time': 1774861898.518016}
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YL77268') HTTP/1.1" 204 0
2026-03-30 09:11:38 [auto1.it] INFO: Found listing with ID: EF61328
2026-03-30 09:11:38 [auto1.it] INFO: Found listing with ID: JK32872
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK32872%27 HTTP/1.1" 200 None
2026-03-30 09:11:38 [auto1.it] INFO: Scrape type for JK32872: 2
2026-03-30 09:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c2914a-4ef9-568e-84d2-aac029dec6fb with identifier: JK32872
2026-03-30 09:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c2914a-4ef9-568e-84d2-aac029dec6fb with scrape type 2
2026-03-30 09:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5c2914a-4ef9-568e-84d2-aac029dec6fb with scrape type 2
2026-03-30 09:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c5c2914a-4ef9-568e-84d2-aac029dec6fb, identifier: JK32872
2026-03-30 09:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1198b50>
2026-03-30 09:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_40f9097920db8896bbabd10ece2c69eb.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_40f9097920db8896bbabd10ece2c69eb.jpg saved to cache
2026-03-30 09:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd396392-94b9-52e5-a20c-5d1c233d2e75
2026-03-30 09:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_7a85527e1e53997ae977d6d130d227ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_11b16be0c9fdc09b6e60375ed09e9c05.jpg> (referer: https://www.auto1.com/)
2026-03-30 09:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c5c2914a-4ef9-568e-84d2-aac029dec6fb with identifier: JK32872
2026-03-30 09:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c5c2914a-4ef9-568e-84d2-aac029dec6fb with identifier: JK32872
2026-03-30 09:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c5c2914a-4ef9-568e-84d2-aac029dec6fb with identifier: JK32872 to the API
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:42:06Z',
 'fuel_type': 'diesel',
 'id': 'c5c2914a-4ef9-568e-84d2-aac029dec6fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK32872',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 140055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-31',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Xmod Attractive',
 'transmission': 'manual',
 'trim': 'Xmod Attractive',
 'year': 2011}
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK32872%27 HTTP/1.1" 200 None
2026-03-30 09:11:39 [auto1.it] INFO: Saving data for JK32872: {'auction_closing_time': 1774885326.0, 'created_time': 1773130017.328132, 'last_price_update_time': 1774861899.090575}
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JK32872') HTTP/1.1" 204 0
2026-03-30 09:11:39 [auto1.it] INFO: Found listing with ID: FU79114
2026-03-30 09:11:39 [auto1.it] INFO: Found listing with ID: NJ78354
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ78354%27 HTTP/1.1" 200 None
2026-03-30 09:11:39 [auto1.it] INFO: Scrape type for NJ78354: 2
2026-03-30 09:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08faaee6-0813-5595-824b-49e97c2960bc with identifier: NJ78354
2026-03-30 09:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08faaee6-0813-5595-824b-49e97c2960bc with scrape type 2
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08faaee6-0813-5595-824b-49e97c2960bc with scrape type 2
2026-03-30 09:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 08faaee6-0813-5595-824b-49e97c2960bc, identifier: NJ78354
2026-03-30 09:11:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1469610>
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_5aaa2745f7168647e4ed1b39b38c2fe0.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_5aaa2745f7168647e4ed1b39b38c2fe0.jpg saved to cache
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c554bb5-b057-521f-b650-242ef5e471bb
2026-03-30 09:11:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1118750>
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_73b3604599421bc21ae3d1bb04d42b82.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_73b3604599421bc21ae3d1bb04d42b82.jpg saved to cache
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c554bb5-b057-521f-b650-242ef5e471bb
2026-03-30 09:11:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee13fd250>
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_682a476b35b7012381c27554f70ae52a.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_682a476b35b7012381c27554f70ae52a.jpg saved to cache
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c554bb5-b057-521f-b650-242ef5e471bb
2026-03-30 09:11:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee2727010>
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252Faf%252F8dafa68ff12ef0a7f3632cba97c6681e%252Fpa%252FTH98415_bf7e96003db69d118df5f705ce8ce512.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_bf7e96003db69d118df5f705ce8ce512.jpg saved to cache
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c554bb5-b057-521f-b650-242ef5e471bb
2026-03-30 09:11:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c554bb5-b057-521f-b650-242ef5e471bb, skipping ID generation
2026-03-30 09:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c554bb5-b057-521f-b650-242ef5e471bb with scrape type 1
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c554bb5-b057-521f-b650-242ef5e471bb sending to next pipeline
2026-03-30 09:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c554bb5-b057-521f-b650-242ef5e471bb, identifier: TH98415
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee111a2d0>
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_7.jpg HTTP/1.1" 201 0
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_5b2287de310fe897f5ed4ec9de55ae9b.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5b2287de310fe897f5ed4ec9de55ae9b.jpg saved to cache
2026-03-30 09:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cd396392-94b9-52e5-a20c-5d1c233d2e75
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1209290>
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_6.jpg HTTP/1.1" 201 0
2026-03-30 09:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_b4a48c09d29d49323289c9c81eefa67f.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_b4a48c09d29d49323289c9c81eefa67f.jpg saved to cache
2026-03-30 09:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd396392-94b9-52e5-a20c-5d1c233d2e75
2026-03-30 09:11:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee12188d0>
2026-03-30 09:11:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_9.jpg HTTP/1.1" 201 0
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_69184dd5303b1feae57fbb93dbfd1279.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_69184dd5303b1feae57fbb93dbfd1279.jpg saved to cache
2026-03-30 09:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd396392-94b9-52e5-a20c-5d1c233d2e75
2026-03-30 09:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 08faaee6-0813-5595-824b-49e97c2960bc with identifier: NJ78354
2026-03-30 09:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 08faaee6-0813-5595-824b-49e97c2960bc with identifier: NJ78354
2026-03-30 09:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 08faaee6-0813-5595-824b-49e97c2960bc with identifier: NJ78354 to the API
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:08Z',
 'fuel_type': 'diesel',
 'id': '08faaee6-0813-5595-824b-49e97c2960bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ78354',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 217515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-31',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2011}
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ78354%27 HTTP/1.1" 200 None
2026-03-30 09:11:40 [auto1.it] INFO: Saving data for NJ78354: {'auction_closing_time': 1774885328.0, 'created_time': 1772654570.28402, 'last_price_update_time': 1774861900.327195}
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NJ78354') HTTP/1.1" 204 0
2026-03-30 09:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c554bb5-b057-521f-b650-242ef5e471bb with identifier: TH98415
2026-03-30 09:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c554bb5-b057-521f-b650-242ef5e471bb with identifier: TH98415
2026-03-30 09:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c554bb5-b057-521f-b650-242ef5e471bb with identifier: TH98415 to the API
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_bf7e96003db69d118df5f705ce8ce512.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 1,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:58:37Z',
 'fuel_type': 'electro',
 'id': '5c554bb5-b057-521f-b650-242ef5e471bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH98415',
 'listing': 'auction',
 'location': 'IT, Taranto',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 84580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_c3092e96d70cc245e800b26dfe67bd59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_f93c26b61fe3cd4296f7d6171752d6ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3011145,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_682a476b35b7012381c27554f70ae52a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_54577c9c69054201402c390d8202040e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2965596,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_5aaa2745f7168647e4ed1b39b38c2fe0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_2a9f9327f19dff4db218f8132409d1da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_ea83a6dc092f197733916b8748b40b20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2856934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_73b3604599421bc21ae3d1bb04d42b82.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_faddf8b21b04456cc8ea3850caa0aae5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c554bb5-b057-521f-b650-242ef5e471bb/5c554bb5-b057-521f-b650-242ef5e471bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2716966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/af/8dafa68ff12ef0a7f3632cba97c6681e/pa/TH98415_bf7e96003db69d118df5f705ce8ce512.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo electric drive 60 kW passion',
 'transmission': 'automatic',
 'trim': 'passion',
 'year': 2018}
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH98415%27 HTTP/1.1" 200 None
2026-03-30 09:11:40 [auto1.it] INFO: Saving data for TH98415: {'created_time': 1774861900.770544, 'last_price_update_time': 1774861900.770557, 'auction_closing_time': 1774972717.0}
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH98415') HTTP/1.1" 204 0
2026-03-30 09:11:40 [auto1.it] INFO: Found listing with ID: TZ83605
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83605%27 HTTP/1.1" 200 None
2026-03-30 09:11:40 [auto1.it] INFO: Scrape type for TZ83605: 2
2026-03-30 09:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with identifier: TZ83605
2026-03-30 09:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with scrape type 2
2026-03-30 09:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with scrape type 2
2026-03-30 09:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227, identifier: TZ83605
2026-03-30 09:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with identifier: TZ83605
2026-03-30 09:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with identifier: TZ83605
2026-03-30 09:11:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with identifier: TZ83605 to the API
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:42:23Z',
 'fuel_type': 'diesel',
 'id': '4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ83605',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 105980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi Live',
 'transmission': 'manual',
 'trim': 'Live',
 'year': 2019}
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83605%27 HTTP/1.1" 200 None
2026-03-30 09:11:41 [auto1.it] INFO: Saving data for TZ83605: {'auction_closing_time': 1774885343.0, 'created_time': 1773130947.433675, 'last_price_update_time': 1774861901.248496}
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ83605') HTTP/1.1" 204 0
2026-03-30 09:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1103390>
2026-03-30 09:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_5.jpg HTTP/1.1" 201 0
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_7a85527e1e53997ae977d6d130d227ea.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_7a85527e1e53997ae977d6d130d227ea.jpg saved to cache
2026-03-30 09:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd396392-94b9-52e5-a20c-5d1c233d2e75
2026-03-30 09:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 09:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f0ee1326d90>
2026-03-30 09:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 09:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_8.jpg HTTP/1.1" 201 0
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F4b%252F964b42734b138479549317048c433ca9%252Fpa%252FSY71538_11b16be0c9fdc09b6e60375ed09e9c05.jpg') HTTP/1.1" 204 0
2026-03-30 09:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_11b16be0c9fdc09b6e60375ed09e9c05.jpg saved to cache
2026-03-30 09:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cd396392-94b9-52e5-a20c-5d1c233d2e75
2026-03-30 09:11:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cd396392-94b9-52e5-a20c-5d1c233d2e75, skipping ID generation
2026-03-30 09:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd396392-94b9-52e5-a20c-5d1c233d2e75 with scrape type 1
2026-03-30 09:11:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd396392-94b9-52e5-a20c-5d1c233d2e75 sending to next pipeline
2026-03-30 09:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd396392-94b9-52e5-a20c-5d1c233d2e75, identifier: SY71538
2026-03-30 09:11:41 [auto1.it] INFO: Found listing with ID: DD73045
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD73045%27 HTTP/1.1" 200 None
2026-03-30 09:11:41 [auto1.it] INFO: Scrape type for DD73045: 0
2026-03-30 09:11:41 [auto1.it] INFO: Found listing with ID: JL50472
2026-03-30 09:11:41 [auto1.it] INFO: Found listing with ID: EA68503
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA68503%27 HTTP/1.1" 200 None
2026-03-30 09:11:41 [auto1.it] INFO: Scrape type for EA68503: 0
2026-03-30 09:11:41 [auto1.it] INFO: Found listing with ID: CC19770
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC19770%27 HTTP/1.1" 200 None
2026-03-30 09:11:41 [auto1.it] INFO: Scrape type for CC19770: 2
2026-03-30 09:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c26435bc-0d06-5dc6-a134-cf841a47c968 with identifier: CC19770
2026-03-30 09:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c26435bc-0d06-5dc6-a134-cf841a47c968 with scrape type 2
2026-03-30 09:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c26435bc-0d06-5dc6-a134-cf841a47c968 with scrape type 2
2026-03-30 09:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c26435bc-0d06-5dc6-a134-cf841a47c968, identifier: CC19770
2026-03-30 09:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd396392-94b9-52e5-a20c-5d1c233d2e75 with identifier: SY71538
2026-03-30 09:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd396392-94b9-52e5-a20c-5d1c233d2e75 with identifier: SY71538
2026-03-30 09:11:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd396392-94b9-52e5-a20c-5d1c233d2e75 with identifier: SY71538 to the API
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_11b16be0c9fdc09b6e60375ed09e9c05.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:34:55Z',
 'fuel_type': 'diesel',
 'id': 'cd396392-94b9-52e5-a20c-5d1c233d2e75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY71538',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 205632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5b4ee02aca75d7765985ca795b20c173.jpg',
             'Width': 769},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124442,
             'Height': 590,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_aa6b7a3fcea72f593876f6d9a6703519.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5d54cd2241b9c7fa31cb5537823d7613.jpg',
             'Width': 772},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_91ca767211064bee80757492f2d6d4eb.jpg',
             'Width': 746},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113032,
             'Height': 599,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_40f9097920db8896bbabd10ece2c69eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_7a85527e1e53997ae977d6d130d227ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_b4a48c09d29d49323289c9c81eefa67f.jpg',
             'Width': 661},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_5b2287de310fe897f5ed4ec9de55ae9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_11b16be0c9fdc09b6e60375ed09e9c05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd396392-94b9-52e5-a20c-5d1c233d2e75/cd396392-94b9-52e5-a20c-5d1c233d2e75_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/4b/964b42734b138479549317048c433ca9/pa/SY71538_69184dd5303b1feae57fbb93dbfd1279.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2015}
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY71538%27 HTTP/1.1" 200 None
2026-03-30 09:11:42 [auto1.it] INFO: Saving data for SY71538: {'created_time': 1774861902.03376, 'last_price_update_time': 1774861902.033778, 'auction_closing_time': 1774971295.0}
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SY71538') HTTP/1.1" 204 0
2026-03-30 09:11:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c26435bc-0d06-5dc6-a134-cf841a47c968 with identifier: CC19770
2026-03-30 09:11:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c26435bc-0d06-5dc6-a134-cf841a47c968 with identifier: CC19770
2026-03-30 09:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c26435bc-0d06-5dc6-a134-cf841a47c968 with identifier: CC19770 to the API
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:18:46Z',
 'fuel_type': 'diesel',
 'id': 'c26435bc-0d06-5dc6-a134-cf841a47c968',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC19770',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 172884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-15',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC19770%27 HTTP/1.1" 200 None
2026-03-30 09:11:42 [auto1.it] INFO: Saving data for CC19770: {'auction_closing_time': 1774883926.0, 'created_time': 1773136056.646315, 'last_price_update_time': 1774861902.327124}
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CC19770') HTTP/1.1" 204 0
2026-03-30 09:11:42 [auto1.it] INFO: Found listing with ID: JJ73686
2026-03-30 09:11:42 [auto1.it] INFO: Found listing with ID: JS86571
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS86571%27 HTTP/1.1" 200 None
2026-03-30 09:11:42 [auto1.it] INFO: Scrape type for JS86571: 2
2026-03-30 09:11:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 237c4e2d-e35c-5a84-ae26-376a17616d52 with identifier: JS86571
2026-03-30 09:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 237c4e2d-e35c-5a84-ae26-376a17616d52 with scrape type 2
2026-03-30 09:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 237c4e2d-e35c-5a84-ae26-376a17616d52 with scrape type 2
2026-03-30 09:11:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 237c4e2d-e35c-5a84-ae26-376a17616d52, identifier: JS86571
2026-03-30 09:11:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 237c4e2d-e35c-5a84-ae26-376a17616d52 with identifier: JS86571
2026-03-30 09:11:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 237c4e2d-e35c-5a84-ae26-376a17616d52 with identifier: JS86571
2026-03-30 09:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 237c4e2d-e35c-5a84-ae26-376a17616d52 with identifier: JS86571 to the API
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:52Z',
 'fuel_type': 'diesel',
 'id': '237c4e2d-e35c-5a84-ae26-376a17616d52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS86571',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 221169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-23',
 'seller_name': None,
 'title': 'Volvo V50 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2011}
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS86571%27 HTTP/1.1" 200 None
2026-03-30 09:11:42 [auto1.it] INFO: Saving data for JS86571: {'auction_closing_time': 1774884772.0, 'created_time': 1773130773.984561, 'last_price_update_time': 1774861902.743847}
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JS86571') HTTP/1.1" 204 0
2026-03-30 09:11:42 [auto1.it] INFO: Found listing with ID: UZ46554
2026-03-30 09:11:42 [auto1.it] INFO: Found listing with ID: PM10706
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM10706%27 HTTP/1.1" 200 None
2026-03-30 09:11:42 [auto1.it] INFO: Scrape type for PM10706: 2
2026-03-30 09:11:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2259f8d-645c-59c2-bd52-c66287dacefb with identifier: PM10706
2026-03-30 09:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2259f8d-645c-59c2-bd52-c66287dacefb with scrape type 2
2026-03-30 09:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2259f8d-645c-59c2-bd52-c66287dacefb with scrape type 2
2026-03-30 09:11:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f2259f8d-645c-59c2-bd52-c66287dacefb, identifier: PM10706
2026-03-30 09:11:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f2259f8d-645c-59c2-bd52-c66287dacefb with identifier: PM10706
2026-03-30 09:11:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f2259f8d-645c-59c2-bd52-c66287dacefb with identifier: PM10706
2026-03-30 09:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f2259f8d-645c-59c2-bd52-c66287dacefb with identifier: PM10706 to the API
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:07:21Z',
 'fuel_type': 'diesel',
 'id': 'f2259f8d-645c-59c2-bd52-c66287dacefb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM10706',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 124350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Citroen C3 1.6 Blue-HDi Monna Lisa',
 'transmission': 'manual',
 'trim': 'Monna Lisa',
 'year': 2017}
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM10706%27 HTTP/1.1" 200 None
2026-03-30 09:11:43 [auto1.it] INFO: Saving data for PM10706: {'auction_closing_time': 1774883241.0, 'created_time': 1773937780.917262, 'last_price_update_time': 1774861903.259924}
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM10706') HTTP/1.1" 204 0
2026-03-30 09:11:43 [auto1.it] INFO: Found listing with ID: CB30744
2026-03-30 09:11:43 [auto1.it] INFO: Found listing with ID: MY09959
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY09959%27 HTTP/1.1" 200 None
2026-03-30 09:11:43 [auto1.it] INFO: Scrape type for MY09959: 2
2026-03-30 09:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4197dfb-bd6a-5e73-94d8-1469525ee31f with identifier: MY09959
2026-03-30 09:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4197dfb-bd6a-5e73-94d8-1469525ee31f with scrape type 2
2026-03-30 09:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4197dfb-bd6a-5e73-94d8-1469525ee31f with scrape type 2
2026-03-30 09:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4197dfb-bd6a-5e73-94d8-1469525ee31f, identifier: MY09959
2026-03-30 09:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4197dfb-bd6a-5e73-94d8-1469525ee31f with identifier: MY09959
2026-03-30 09:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4197dfb-bd6a-5e73-94d8-1469525ee31f with identifier: MY09959
2026-03-30 09:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4197dfb-bd6a-5e73-94d8-1469525ee31f with identifier: MY09959 to the API
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:07:52Z',
 'fuel_type': 'diesel',
 'id': 'd4197dfb-bd6a-5e73-94d8-1469525ee31f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY09959',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 258321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-04',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic Business',
 'transmission': 'automatic',
 'trim': '4Matic Business',
 'year': 2016}
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY09959%27 HTTP/1.1" 200 None
2026-03-30 09:11:43 [auto1.it] INFO: Saving data for MY09959: {'auction_closing_time': 1774883272.0, 'created_time': 1771704497.022483, 'last_price_update_time': 1774861903.688236}
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MY09959') HTTP/1.1" 204 0
2026-03-30 09:11:43 [auto1.it] INFO: Found listing with ID: ML86144
2026-03-30 09:11:43 [auto1.it] INFO: Found listing with ID: JM74615
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM74615%27 HTTP/1.1" 200 None
2026-03-30 09:11:43 [auto1.it] INFO: Scrape type for JM74615: 0
2026-03-30 09:11:43 [auto1.it] INFO: Found listing with ID: HK60506
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK60506%27 HTTP/1.1" 200 None
2026-03-30 09:11:43 [auto1.it] INFO: Scrape type for HK60506: 2
2026-03-30 09:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5722565-16bc-5568-bfe6-e38120db65e6 with identifier: HK60506
2026-03-30 09:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5722565-16bc-5568-bfe6-e38120db65e6 with scrape type 2
2026-03-30 09:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5722565-16bc-5568-bfe6-e38120db65e6 with scrape type 2
2026-03-30 09:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e5722565-16bc-5568-bfe6-e38120db65e6, identifier: HK60506
2026-03-30 09:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e5722565-16bc-5568-bfe6-e38120db65e6 with identifier: HK60506
2026-03-30 09:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e5722565-16bc-5568-bfe6-e38120db65e6 with identifier: HK60506
2026-03-30 09:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e5722565-16bc-5568-bfe6-e38120db65e6 with identifier: HK60506 to the API
2026-03-30 09:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:54:02Z',
 'fuel_type': 'petrol',
 'id': 'e5722565-16bc-5568-bfe6-e38120db65e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK60506',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 53075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-29',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Stop&Start',
 'transmission': 'automatic',
 'trim': 'Stop&Start',
 'year': 2009}
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK60506%27 HTTP/1.1" 200 None
2026-03-30 09:11:44 [auto1.it] INFO: Saving data for HK60506: {'auction_closing_time': 1774886042.0, 'created_time': 1773136053.587947, 'last_price_update_time': 1774861904.117936}
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HK60506') HTTP/1.1" 204 0
2026-03-30 09:11:44 [auto1.it] INFO: Found listing with ID: ZU26854
2026-03-30 09:11:44 [auto1.it] INFO: Found listing with ID: DR95248
2026-03-30 09:11:44 [auto1.it] INFO: Found listing with ID: UK81379
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK81379%27 HTTP/1.1" 200 None
2026-03-30 09:11:44 [auto1.it] INFO: Scrape type for UK81379: 2
2026-03-30 09:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4389e757-555a-5e77-a5b7-c9be14a150d3 with identifier: UK81379
2026-03-30 09:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4389e757-555a-5e77-a5b7-c9be14a150d3 with scrape type 2
2026-03-30 09:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4389e757-555a-5e77-a5b7-c9be14a150d3 with scrape type 2
2026-03-30 09:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4389e757-555a-5e77-a5b7-c9be14a150d3, identifier: UK81379
2026-03-30 09:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4389e757-555a-5e77-a5b7-c9be14a150d3 with identifier: UK81379
2026-03-30 09:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4389e757-555a-5e77-a5b7-c9be14a150d3 with identifier: UK81379
2026-03-30 09:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4389e757-555a-5e77-a5b7-c9be14a150d3 with identifier: UK81379 to the API
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:48Z',
 'fuel_type': 'diesel',
 'id': '4389e757-555a-5e77-a5b7-c9be14a150d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK81379',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 74550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-01',
 'seller_name': None,
 'title': 'Audi Q2 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK81379%27 HTTP/1.1" 200 None
2026-03-30 09:11:44 [auto1.it] INFO: Saving data for UK81379: {'auction_closing_time': 1774882848.0, 'created_time': 1774300114.059997, 'last_price_update_time': 1774861904.633128}
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK81379') HTTP/1.1" 204 0
2026-03-30 09:11:44 [auto1.it] INFO: Found listing with ID: DW65816
2026-03-30 09:11:44 [auto1.it] INFO: Found listing with ID: BX49691
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX49691%27 HTTP/1.1" 200 None
2026-03-30 09:11:44 [auto1.it] INFO: Scrape type for BX49691: 2
2026-03-30 09:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1cf368e-0756-5ce7-bea1-a41cc6f3b814 with identifier: BX49691
2026-03-30 09:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1cf368e-0756-5ce7-bea1-a41cc6f3b814 with scrape type 2
2026-03-30 09:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1cf368e-0756-5ce7-bea1-a41cc6f3b814 with scrape type 2
2026-03-30 09:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d1cf368e-0756-5ce7-bea1-a41cc6f3b814, identifier: BX49691
2026-03-30 09:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d1cf368e-0756-5ce7-bea1-a41cc6f3b814 with identifier: BX49691
2026-03-30 09:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d1cf368e-0756-5ce7-bea1-a41cc6f3b814 with identifier: BX49691
2026-03-30 09:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d1cf368e-0756-5ce7-bea1-a41cc6f3b814 with identifier: BX49691 to the API
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:00Z',
 'fuel_type': 'petrol',
 'id': 'd1cf368e-0756-5ce7-bea1-a41cc6f3b814',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX49691',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 107514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-04',
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 TGDi Limited 4x2',
 'transmission': 'automatic',
 'trim': 'Limited 4x2',
 'year': 2021}
2026-03-30 09:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX49691%27 HTTP/1.1" 200 None
2026-03-30 09:11:45 [auto1.it] INFO: Saving data for BX49691: {'auction_closing_time': 1774886040.0, 'created_time': 1772308833.239587, 'last_price_update_time': 1774861905.049424}
2026-03-30 09:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BX49691') HTTP/1.1" 204 0
2026-03-30 09:11:45 [auto1.it] INFO: Found listing with ID: AL00602
2026-03-30 09:11:45 [auto1.it] INFO: Found listing with ID: MX95744
2026-03-30 09:11:45 [auto1.it] INFO: Found listing with ID: KC58138
2026-03-30 09:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC58138%27 HTTP/1.1" 200 None
2026-03-30 09:11:45 [auto1.it] INFO: Scrape type for KC58138: 2
2026-03-30 09:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with identifier: KC58138
2026-03-30 09:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with scrape type 2
2026-03-30 09:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with scrape type 2
2026-03-30 09:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46eab6e0-c269-52f3-ab4e-53eceb45ecc1, identifier: KC58138
2026-03-30 09:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with identifier: KC58138
2026-03-30 09:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with identifier: KC58138
2026-03-30 09:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 46eab6e0-c269-52f3-ab4e-53eceb45ecc1 with identifier: KC58138 to the API
2026-03-30 09:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:25:55Z',
 'fuel_type': 'diesel',
 'id': '46eab6e0-c269-52f3-ab4e-53eceb45ecc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC58138',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 108774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-01',
 'seller_name': None,
 'title': 'Audi Q7 50 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC58138%27 HTTP/1.1" 200 None
2026-03-30 09:11:46 [auto1.it] INFO: Saving data for KC58138: {'auction_closing_time': 1774884355.0, 'created_time': 1774386656.462032, 'last_price_update_time': 1774861906.152118}
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC58138') HTTP/1.1" 204 0
2026-03-30 09:11:46 [auto1.it] INFO: Found listing with ID: DP76328
2026-03-30 09:11:46 [auto1.it] INFO: Found listing with ID: UY83511
2026-03-30 09:11:46 [auto1.it] INFO: Found listing with ID: HM97674
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM97674%27 HTTP/1.1" 200 None
2026-03-30 09:11:46 [auto1.it] INFO: Scrape type for HM97674: 2
2026-03-30 09:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d2a20d2-701b-5224-aa9d-2018c50eaf1f with identifier: HM97674
2026-03-30 09:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d2a20d2-701b-5224-aa9d-2018c50eaf1f with scrape type 2
2026-03-30 09:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d2a20d2-701b-5224-aa9d-2018c50eaf1f with scrape type 2
2026-03-30 09:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7d2a20d2-701b-5224-aa9d-2018c50eaf1f, identifier: HM97674
2026-03-30 09:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7d2a20d2-701b-5224-aa9d-2018c50eaf1f with identifier: HM97674
2026-03-30 09:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7d2a20d2-701b-5224-aa9d-2018c50eaf1f with identifier: HM97674
2026-03-30 09:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7d2a20d2-701b-5224-aa9d-2018c50eaf1f with identifier: HM97674 to the API
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:45Z',
 'fuel_type': 'petrol',
 'id': '7d2a20d2-701b-5224-aa9d-2018c50eaf1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM97674',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 45476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-25',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM97674%27 HTTP/1.1" 200 None
2026-03-30 09:11:46 [auto1.it] INFO: Saving data for HM97674: {'auction_closing_time': 1774883565.0, 'created_time': 1773130580.074691, 'last_price_update_time': 1774861906.650004}
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HM97674') HTTP/1.1" 204 0
2026-03-30 09:11:46 [auto1.it] INFO: Found listing with ID: DF59331
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF59331%27 HTTP/1.1" 200 None
2026-03-30 09:11:46 [auto1.it] INFO: Scrape type for DF59331: 2
2026-03-30 09:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78a80183-4fdc-5716-affa-73234dcaece7 with identifier: DF59331
2026-03-30 09:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78a80183-4fdc-5716-affa-73234dcaece7 with scrape type 2
2026-03-30 09:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78a80183-4fdc-5716-affa-73234dcaece7 with scrape type 2
2026-03-30 09:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 78a80183-4fdc-5716-affa-73234dcaece7, identifier: DF59331
2026-03-30 09:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 78a80183-4fdc-5716-affa-73234dcaece7 with identifier: DF59331
2026-03-30 09:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 78a80183-4fdc-5716-affa-73234dcaece7 with identifier: DF59331
2026-03-30 09:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 78a80183-4fdc-5716-affa-73234dcaece7 with identifier: DF59331 to the API
2026-03-30 09:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:20:26Z',
 'fuel_type': 'petrol',
 'id': '78a80183-4fdc-5716-affa-73234dcaece7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF59331',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 124892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-09',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Argento',
 'transmission': 'manual',
 'trim': 'Argento',
 'year': 2010}
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF59331%27 HTTP/1.1" 200 None
2026-03-30 09:11:47 [auto1.it] INFO: Saving data for DF59331: {'auction_closing_time': 1774884026.0, 'created_time': 1773136060.077522, 'last_price_update_time': 1774861907.464039}
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DF59331') HTTP/1.1" 204 0
2026-03-30 09:11:47 [auto1.it] INFO: Found listing with ID: MR40406
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR40406%27 HTTP/1.1" 200 None
2026-03-30 09:11:47 [auto1.it] INFO: Scrape type for MR40406: 2
2026-03-30 09:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95a1507d-0614-521b-8119-4ef2f3e8d557 with identifier: MR40406
2026-03-30 09:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95a1507d-0614-521b-8119-4ef2f3e8d557 with scrape type 2
2026-03-30 09:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95a1507d-0614-521b-8119-4ef2f3e8d557 with scrape type 2
2026-03-30 09:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95a1507d-0614-521b-8119-4ef2f3e8d557, identifier: MR40406
2026-03-30 09:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95a1507d-0614-521b-8119-4ef2f3e8d557 with identifier: MR40406
2026-03-30 09:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95a1507d-0614-521b-8119-4ef2f3e8d557 with identifier: MR40406
2026-03-30 09:11:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 95a1507d-0614-521b-8119-4ef2f3e8d557 with identifier: MR40406 to the API
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:29:16Z',
 'fuel_type': 'petrol',
 'id': '95a1507d-0614-521b-8119-4ef2f3e8d557',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR40406',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 137746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-16',
 'seller_name': None,
 'title': 'Citroen C3 1.2 e-VTi Feel Edition',
 'transmission': 'manual',
 'trim': 'Feel Edition',
 'year': 2016}
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR40406%27 HTTP/1.1" 200 None
2026-03-30 09:11:47 [auto1.it] INFO: Saving data for MR40406: {'auction_closing_time': 1774884556.0, 'created_time': 1773130553.997819, 'last_price_update_time': 1774861907.857152}
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR40406') HTTP/1.1" 204 0
2026-03-30 09:11:47 [auto1.it] INFO: Found listing with ID: KP16451
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP16451%27 HTTP/1.1" 200 None
2026-03-30 09:11:47 [auto1.it] INFO: Scrape type for KP16451: 2
2026-03-30 09:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c55004b0-23c4-5403-a907-db29b9c165a1 with identifier: KP16451
2026-03-30 09:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c55004b0-23c4-5403-a907-db29b9c165a1 with scrape type 2
2026-03-30 09:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c55004b0-23c4-5403-a907-db29b9c165a1 with scrape type 2
2026-03-30 09:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c55004b0-23c4-5403-a907-db29b9c165a1, identifier: KP16451
2026-03-30 09:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c55004b0-23c4-5403-a907-db29b9c165a1 with identifier: KP16451
2026-03-30 09:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c55004b0-23c4-5403-a907-db29b9c165a1 with identifier: KP16451
2026-03-30 09:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c55004b0-23c4-5403-a907-db29b9c165a1 with identifier: KP16451 to the API
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:53:59Z',
 'fuel_type': 'diesel',
 'id': 'c55004b0-23c4-5403-a907-db29b9c165a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP16451',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 170053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-03',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2020}
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP16451%27 HTTP/1.1" 200 None
2026-03-30 09:11:48 [auto1.it] INFO: Saving data for KP16451: {'auction_closing_time': 1774886039.0, 'created_time': 1773130533.828914, 'last_price_update_time': 1774861908.345699}
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KP16451') HTTP/1.1" 204 0
2026-03-30 09:11:48 [auto1.it] INFO: Channel: 24h | Page: 28 | totalHits: 3312 | hits on page: 40
2026-03-30 09:11:48 [auto1.it] INFO: Found listing with ID: BX11314
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX11314%27 HTTP/1.1" 200 None
2026-03-30 09:11:48 [auto1.it] INFO: Scrape type for BX11314: 2
2026-03-30 09:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34708c1b-7e29-5f76-8e9c-46af305abb1a with identifier: BX11314
2026-03-30 09:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34708c1b-7e29-5f76-8e9c-46af305abb1a with scrape type 2
2026-03-30 09:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34708c1b-7e29-5f76-8e9c-46af305abb1a with scrape type 2
2026-03-30 09:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34708c1b-7e29-5f76-8e9c-46af305abb1a, identifier: BX11314
2026-03-30 09:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34708c1b-7e29-5f76-8e9c-46af305abb1a with identifier: BX11314
2026-03-30 09:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34708c1b-7e29-5f76-8e9c-46af305abb1a with identifier: BX11314
2026-03-30 09:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34708c1b-7e29-5f76-8e9c-46af305abb1a with identifier: BX11314 to the API
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:20:26Z',
 'fuel_type': 'diesel',
 'id': '34708c1b-7e29-5f76-8e9c-46af305abb1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX11314',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 302595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'BMW X5 xDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX11314%27 HTTP/1.1" 200 None
2026-03-30 09:11:48 [auto1.it] INFO: Saving data for BX11314: {'auction_closing_time': 1774884026.0, 'created_time': 1771021740.293316, 'last_price_update_time': 1774861908.752192}
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BX11314') HTTP/1.1" 204 0
2026-03-30 09:11:48 [auto1.it] INFO: Found listing with ID: TU23775
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU23775%27 HTTP/1.1" 200 None
2026-03-30 09:11:48 [auto1.it] INFO: Scrape type for TU23775: 2
2026-03-30 09:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5155f566-79d3-572a-9489-714694d8fcf5 with identifier: TU23775
2026-03-30 09:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5155f566-79d3-572a-9489-714694d8fcf5 with scrape type 2
2026-03-30 09:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5155f566-79d3-572a-9489-714694d8fcf5 with scrape type 2
2026-03-30 09:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5155f566-79d3-572a-9489-714694d8fcf5, identifier: TU23775
2026-03-30 09:11:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:48 [auto1.it] INFO: Found listing with ID: XR19887
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR19887%27 HTTP/1.1" 200 None
2026-03-30 09:11:48 [auto1.it] INFO: Scrape type for XR19887: 2
2026-03-30 09:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27016423-0db4-5467-9db7-f2fc89293910 with identifier: XR19887
2026-03-30 09:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27016423-0db4-5467-9db7-f2fc89293910 with scrape type 2
2026-03-30 09:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27016423-0db4-5467-9db7-f2fc89293910 with scrape type 2
2026-03-30 09:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27016423-0db4-5467-9db7-f2fc89293910, identifier: XR19887
2026-03-30 09:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5155f566-79d3-572a-9489-714694d8fcf5 with identifier: TU23775
2026-03-30 09:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5155f566-79d3-572a-9489-714694d8fcf5 with identifier: TU23775
2026-03-30 09:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5155f566-79d3-572a-9489-714694d8fcf5 with identifier: TU23775 to the API
2026-03-30 09:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:13:13Z',
 'fuel_type': 'petrol',
 'id': '5155f566-79d3-572a-9489-714694d8fcf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU23775',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 74368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-28',
 'seller_name': None,
 'title': 'Citroen C3 1.1 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-30 09:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU23775%27 HTTP/1.1" 200 None
2026-03-30 09:11:49 [auto1.it] INFO: Saving data for TU23775: {'auction_closing_time': 1774883593.0, 'created_time': 1771876994.054444, 'last_price_update_time': 1774861909.370123}
2026-03-30 09:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU23775') HTTP/1.1" 204 0
2026-03-30 09:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27016423-0db4-5467-9db7-f2fc89293910 with identifier: XR19887
2026-03-30 09:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27016423-0db4-5467-9db7-f2fc89293910 with identifier: XR19887
2026-03-30 09:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 27016423-0db4-5467-9db7-f2fc89293910 with identifier: XR19887 to the API
2026-03-30 09:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:42:17Z',
 'fuel_type': 'petrol',
 'id': '27016423-0db4-5467-9db7-f2fc89293910',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR19887',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ2',
 'odometer': 19947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-09',
 'seller_name': None,
 'title': 'Audi SQ2 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR19887%27 HTTP/1.1" 200 None
2026-03-30 09:11:50 [auto1.it] INFO: Saving data for XR19887: {'auction_closing_time': 1774885337.0, 'created_time': 1774473196.265218, 'last_price_update_time': 1774861910.265233}
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XR19887') HTTP/1.1" 204 0
2026-03-30 09:11:50 [auto1.it] INFO: Found listing with ID: ST52943
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST52943%27 HTTP/1.1" 200 None
2026-03-30 09:11:50 [auto1.it] INFO: Scrape type for ST52943: 0
2026-03-30 09:11:50 [auto1.it] INFO: Found listing with ID: AB43384
2026-03-30 09:11:50 [auto1.it] INFO: Found listing with ID: XF42049
2026-03-30 09:11:50 [auto1.it] INFO: Found listing with ID: CM37896
2026-03-30 09:11:50 [auto1.it] INFO: Found listing with ID: NP19925
2026-03-30 09:11:50 [auto1.it] INFO: Found listing with ID: VZ89804
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ89804%27 HTTP/1.1" 200 None
2026-03-30 09:11:50 [auto1.it] INFO: Scrape type for VZ89804: 0
2026-03-30 09:11:50 [auto1.it] INFO: Found listing with ID: KU20000
2026-03-30 09:11:50 [auto1.it] INFO: Found listing with ID: BS34699
2026-03-30 09:11:50 [auto1.it] INFO: Found listing with ID: AS57750
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS57750%27 HTTP/1.1" 200 None
2026-03-30 09:11:50 [auto1.it] INFO: Scrape type for AS57750: 2
2026-03-30 09:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a91f5b7f-f776-586e-a2d0-775a6a343112 with identifier: AS57750
2026-03-30 09:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91f5b7f-f776-586e-a2d0-775a6a343112 with scrape type 2
2026-03-30 09:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a91f5b7f-f776-586e-a2d0-775a6a343112 with scrape type 2
2026-03-30 09:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a91f5b7f-f776-586e-a2d0-775a6a343112, identifier: AS57750
2026-03-30 09:11:50 [auto1.it] INFO: Found listing with ID: JZ39211
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ39211%27 HTTP/1.1" 200 None
2026-03-30 09:11:50 [auto1.it] INFO: Scrape type for JZ39211: 2
2026-03-30 09:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12a2e077-8aa9-53ef-8672-0f8738665e32 with identifier: JZ39211
2026-03-30 09:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12a2e077-8aa9-53ef-8672-0f8738665e32 with scrape type 2
2026-03-30 09:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12a2e077-8aa9-53ef-8672-0f8738665e32 with scrape type 2
2026-03-30 09:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12a2e077-8aa9-53ef-8672-0f8738665e32, identifier: JZ39211
2026-03-30 09:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a91f5b7f-f776-586e-a2d0-775a6a343112 with identifier: AS57750
2026-03-30 09:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a91f5b7f-f776-586e-a2d0-775a6a343112 with identifier: AS57750
2026-03-30 09:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a91f5b7f-f776-586e-a2d0-775a6a343112 with identifier: AS57750 to the API
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:17:50Z',
 'fuel_type': 'petrol',
 'id': 'a91f5b7f-f776-586e-a2d0-775a6a343112',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS57750',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 137853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-14',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Oro',
 'transmission': 'manual',
 'trim': 'Oro',
 'year': 2009}
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS57750%27 HTTP/1.1" 200 None
2026-03-30 09:11:50 [auto1.it] INFO: Saving data for AS57750: {'auction_closing_time': 1774883870.0, 'created_time': 1773130639.552482, 'last_price_update_time': 1774861910.85336}
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AS57750') HTTP/1.1" 204 0
2026-03-30 09:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12a2e077-8aa9-53ef-8672-0f8738665e32 with identifier: JZ39211
2026-03-30 09:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12a2e077-8aa9-53ef-8672-0f8738665e32 with identifier: JZ39211
2026-03-30 09:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 12a2e077-8aa9-53ef-8672-0f8738665e32 with identifier: JZ39211 to the API
2026-03-30 09:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:49:19Z',
 'fuel_type': 'petrol',
 'id': '12a2e077-8aa9-53ef-8672-0f8738665e32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ39211',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 95043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-16',
 'seller_name': None,
 'title': 'Opel Agila 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ39211%27 HTTP/1.1" 200 None
2026-03-30 09:11:51 [auto1.it] INFO: Saving data for JZ39211: {'auction_closing_time': 1774885759.0, 'created_time': 1771704175.270797, 'last_price_update_time': 1774861911.144585}
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ39211') HTTP/1.1" 204 0
2026-03-30 09:11:51 [auto1.it] INFO: Found listing with ID: PW94322
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94322%27 HTTP/1.1" 200 None
2026-03-30 09:11:51 [auto1.it] INFO: Scrape type for PW94322: 2
2026-03-30 09:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c10daf5-f2b0-5614-957c-aea4280d6ccc with identifier: PW94322
2026-03-30 09:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c10daf5-f2b0-5614-957c-aea4280d6ccc with scrape type 2
2026-03-30 09:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c10daf5-f2b0-5614-957c-aea4280d6ccc with scrape type 2
2026-03-30 09:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8c10daf5-f2b0-5614-957c-aea4280d6ccc, identifier: PW94322
2026-03-30 09:11:51 [auto1.it] INFO: Found listing with ID: EG37801
2026-03-30 09:11:51 [auto1.it] INFO: Found listing with ID: HF76476
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF76476%27 HTTP/1.1" 200 None
2026-03-30 09:11:51 [auto1.it] INFO: Scrape type for HF76476: 2
2026-03-30 09:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd04dfba-fcec-5fcc-82e0-b1cd790c8100 with identifier: HF76476
2026-03-30 09:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd04dfba-fcec-5fcc-82e0-b1cd790c8100 with scrape type 2
2026-03-30 09:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd04dfba-fcec-5fcc-82e0-b1cd790c8100 with scrape type 2
2026-03-30 09:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd04dfba-fcec-5fcc-82e0-b1cd790c8100, identifier: HF76476
2026-03-30 09:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8c10daf5-f2b0-5614-957c-aea4280d6ccc with identifier: PW94322
2026-03-30 09:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8c10daf5-f2b0-5614-957c-aea4280d6ccc with identifier: PW94322
2026-03-30 09:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8c10daf5-f2b0-5614-957c-aea4280d6ccc with identifier: PW94322 to the API
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:29:56Z',
 'fuel_type': 'diesel',
 'id': '8c10daf5-f2b0-5614-957c-aea4280d6ccc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW94322',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 229543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-03',
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Exceed',
 'transmission': 'manual',
 'trim': 'Exceed',
 'year': 2015}
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94322%27 HTTP/1.1" 200 None
2026-03-30 09:11:51 [auto1.it] INFO: Saving data for PW94322: {'auction_closing_time': 1774884596.0, 'created_time': 1773129760.127722, 'last_price_update_time': 1774861911.696767}
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW94322') HTTP/1.1" 204 0
2026-03-30 09:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd04dfba-fcec-5fcc-82e0-b1cd790c8100 with identifier: HF76476
2026-03-30 09:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd04dfba-fcec-5fcc-82e0-b1cd790c8100 with identifier: HF76476
2026-03-30 09:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd04dfba-fcec-5fcc-82e0-b1cd790c8100 with identifier: HF76476 to the API
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:51:19Z',
 'fuel_type': 'diesel',
 'id': 'cd04dfba-fcec-5fcc-82e0-b1cd790c8100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF76476',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Hilux',
 'odometer': 196776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-10',
 'seller_name': None,
 'title': 'Toyota Hilux 3.0 Turbodiesel Double Cab Executive 4x4',
 'transmission': 'manual',
 'trim': 'Double Cab Executive 4x4',
 'year': 2009}
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF76476%27 HTTP/1.1" 200 None
2026-03-30 09:11:52 [auto1.it] INFO: Saving data for HF76476: {'auction_closing_time': 1774885879.0, 'created_time': 1774473127.873284, 'last_price_update_time': 1774861912.072521}
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HF76476') HTTP/1.1" 204 0
2026-03-30 09:11:52 [auto1.it] INFO: Found listing with ID: FU65166
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU65166%27 HTTP/1.1" 200 None
2026-03-30 09:11:52 [auto1.it] INFO: Scrape type for FU65166: 2
2026-03-30 09:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41d1c026-6b50-5e57-af94-ad42131f53bc with identifier: FU65166
2026-03-30 09:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41d1c026-6b50-5e57-af94-ad42131f53bc with scrape type 2
2026-03-30 09:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41d1c026-6b50-5e57-af94-ad42131f53bc with scrape type 2
2026-03-30 09:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 41d1c026-6b50-5e57-af94-ad42131f53bc, identifier: FU65166
2026-03-30 09:11:52 [auto1.it] INFO: Found listing with ID: AK59444
2026-03-30 09:11:52 [auto1.it] INFO: Found listing with ID: BK23225
2026-03-30 09:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 41d1c026-6b50-5e57-af94-ad42131f53bc with identifier: FU65166
2026-03-30 09:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 41d1c026-6b50-5e57-af94-ad42131f53bc with identifier: FU65166
2026-03-30 09:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 41d1c026-6b50-5e57-af94-ad42131f53bc with identifier: FU65166 to the API
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:55:31Z',
 'fuel_type': 'diesel',
 'id': '41d1c026-6b50-5e57-af94-ad42131f53bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU65166',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 228020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-30',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU65166%27 HTTP/1.1" 200 None
2026-03-30 09:11:52 [auto1.it] INFO: Saving data for FU65166: {'auction_closing_time': 1774886131.0, 'created_time': 1773132348.312777, 'last_price_update_time': 1774861912.475338}
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FU65166') HTTP/1.1" 204 0
2026-03-30 09:11:52 [auto1.it] INFO: Found listing with ID: LG94393
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG94393%27 HTTP/1.1" 200 None
2026-03-30 09:11:52 [auto1.it] INFO: Scrape type for LG94393: 2
2026-03-30 09:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad7b34b6-8fb7-53ef-b401-f814dccc884d with identifier: LG94393
2026-03-30 09:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad7b34b6-8fb7-53ef-b401-f814dccc884d with scrape type 2
2026-03-30 09:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad7b34b6-8fb7-53ef-b401-f814dccc884d with scrape type 2
2026-03-30 09:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ad7b34b6-8fb7-53ef-b401-f814dccc884d, identifier: LG94393
2026-03-30 09:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ad7b34b6-8fb7-53ef-b401-f814dccc884d with identifier: LG94393
2026-03-30 09:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ad7b34b6-8fb7-53ef-b401-f814dccc884d with identifier: LG94393
2026-03-30 09:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ad7b34b6-8fb7-53ef-b401-f814dccc884d with identifier: LG94393 to the API
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:02:17Z',
 'fuel_type': 'diesel',
 'id': 'ad7b34b6-8fb7-53ef-b401-f814dccc884d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG94393',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 135297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-31',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'automatic',
 'trim': 'Standard',
 'year': 2011}
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG94393%27 HTTP/1.1" 200 None
2026-03-30 09:11:52 [auto1.it] INFO: Saving data for LG94393: {'auction_closing_time': 1774882937.0, 'created_time': 1772188258.403832, 'last_price_update_time': 1774861912.901511}
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG94393') HTTP/1.1" 204 0
2026-03-30 09:11:52 [auto1.it] INFO: Found listing with ID: AB09853
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB09853%27 HTTP/1.1" 200 None
2026-03-30 09:11:52 [auto1.it] INFO: Scrape type for AB09853: 2
2026-03-30 09:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97251b51-e0de-5f20-9d92-cf4ee8518510 with identifier: AB09853
2026-03-30 09:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97251b51-e0de-5f20-9d92-cf4ee8518510 with scrape type 2
2026-03-30 09:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97251b51-e0de-5f20-9d92-cf4ee8518510 with scrape type 2
2026-03-30 09:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97251b51-e0de-5f20-9d92-cf4ee8518510, identifier: AB09853
2026-03-30 09:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97251b51-e0de-5f20-9d92-cf4ee8518510 with identifier: AB09853
2026-03-30 09:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97251b51-e0de-5f20-9d92-cf4ee8518510 with identifier: AB09853
2026-03-30 09:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97251b51-e0de-5f20-9d92-cf4ee8518510 with identifier: AB09853 to the API
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:30:15Z',
 'fuel_type': 'petrol',
 'id': '97251b51-e0de-5f20-9d92-cf4ee8518510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB09853',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 16250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-21',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 DualJet Mild-Hybrid Top',
 'transmission': 'manual',
 'trim': 'Top',
 'year': 2023}
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB09853%27 HTTP/1.1" 200 None
2026-03-30 09:11:53 [auto1.it] INFO: Saving data for AB09853: {'auction_closing_time': 1774884615.0, 'created_time': 1773130308.211842, 'last_price_update_time': 1774861913.356451}
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AB09853') HTTP/1.1" 204 0
2026-03-30 09:11:53 [auto1.it] INFO: Found listing with ID: BL94999
2026-03-30 09:11:53 [auto1.it] INFO: Found listing with ID: PE73293
2026-03-30 09:11:53 [auto1.it] INFO: Found listing with ID: LW03785
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW03785%27 HTTP/1.1" 200 None
2026-03-30 09:11:53 [auto1.it] INFO: Scrape type for LW03785: 2
2026-03-30 09:11:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d99ec62-ec3a-592e-865b-d2584968c72e with identifier: LW03785
2026-03-30 09:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d99ec62-ec3a-592e-865b-d2584968c72e with scrape type 2
2026-03-30 09:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d99ec62-ec3a-592e-865b-d2584968c72e with scrape type 2
2026-03-30 09:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6d99ec62-ec3a-592e-865b-d2584968c72e, identifier: LW03785
2026-03-30 09:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6d99ec62-ec3a-592e-865b-d2584968c72e with identifier: LW03785
2026-03-30 09:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6d99ec62-ec3a-592e-865b-d2584968c72e with identifier: LW03785
2026-03-30 09:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6d99ec62-ec3a-592e-865b-d2584968c72e with identifier: LW03785 to the API
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:26:53Z',
 'fuel_type': 'hybrid',
 'id': '6d99ec62-ec3a-592e-865b-d2584968c72e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW03785',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 246945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-22',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2013}
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW03785%27 HTTP/1.1" 200 None
2026-03-30 09:11:53 [auto1.it] INFO: Saving data for LW03785: {'auction_closing_time': 1774884413.0, 'created_time': 1773131757.58409, 'last_price_update_time': 1774861913.756005}
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LW03785') HTTP/1.1" 204 0
2026-03-30 09:11:53 [auto1.it] INFO: Found listing with ID: UP48367
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP48367%27 HTTP/1.1" 200 None
2026-03-30 09:11:53 [auto1.it] INFO: Scrape type for UP48367: 2
2026-03-30 09:11:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2e3a76-7810-5d6e-a16f-189a3ba21870 with identifier: UP48367
2026-03-30 09:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2e3a76-7810-5d6e-a16f-189a3ba21870 with scrape type 2
2026-03-30 09:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2e3a76-7810-5d6e-a16f-189a3ba21870 with scrape type 2
2026-03-30 09:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: da2e3a76-7810-5d6e-a16f-189a3ba21870, identifier: UP48367
2026-03-30 09:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: da2e3a76-7810-5d6e-a16f-189a3ba21870 with identifier: UP48367
2026-03-30 09:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: da2e3a76-7810-5d6e-a16f-189a3ba21870 with identifier: UP48367
2026-03-30 09:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: da2e3a76-7810-5d6e-a16f-189a3ba21870 with identifier: UP48367 to the API
2026-03-30 09:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:00:05Z',
 'fuel_type': 'diesel',
 'id': 'da2e3a76-7810-5d6e-a16f-189a3ba21870',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP48367',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 162798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-15',
 'seller_name': None,
 'title': 'Fiat 500X 1.6 JTDM Pop Star',
 'transmission': 'automatic',
 'trim': 'Pop Star',
 'year': 2018}
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP48367%27 HTTP/1.1" 200 None
2026-03-30 09:11:54 [auto1.it] INFO: Saving data for UP48367: {'auction_closing_time': 1774882805.0, 'created_time': 1773130839.054759, 'last_price_update_time': 1774861914.147567}
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UP48367') HTTP/1.1" 204 0
2026-03-30 09:11:54 [auto1.it] INFO: Found listing with ID: LW86273
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW86273%27 HTTP/1.1" 200 None
2026-03-30 09:11:54 [auto1.it] INFO: Scrape type for LW86273: 2
2026-03-30 09:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ee631ed-04ac-5ac7-8630-b6f877a05ebc with identifier: LW86273
2026-03-30 09:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ee631ed-04ac-5ac7-8630-b6f877a05ebc with scrape type 2
2026-03-30 09:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ee631ed-04ac-5ac7-8630-b6f877a05ebc with scrape type 2
2026-03-30 09:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ee631ed-04ac-5ac7-8630-b6f877a05ebc, identifier: LW86273
2026-03-30 09:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ee631ed-04ac-5ac7-8630-b6f877a05ebc with identifier: LW86273
2026-03-30 09:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ee631ed-04ac-5ac7-8630-b6f877a05ebc with identifier: LW86273
2026-03-30 09:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ee631ed-04ac-5ac7-8630-b6f877a05ebc with identifier: LW86273 to the API
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:50Z',
 'fuel_type': 'diesel',
 'id': '5ee631ed-04ac-5ac7-8630-b6f877a05ebc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW86273',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 173086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI clean diesel',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW86273%27 HTTP/1.1" 200 None
2026-03-30 09:11:54 [auto1.it] INFO: Saving data for LW86273: {'auction_closing_time': 1774886390.0, 'created_time': 1772143072.798598, 'last_price_update_time': 1774861914.544958}
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LW86273') HTTP/1.1" 204 0
2026-03-30 09:11:54 [auto1.it] INFO: Found listing with ID: LY27741
2026-03-30 09:11:54 [auto1.it] INFO: Found listing with ID: YA33323
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA33323%27 HTTP/1.1" 200 None
2026-03-30 09:11:54 [auto1.it] INFO: Scrape type for YA33323: 0
2026-03-30 09:11:54 [auto1.it] INFO: Found listing with ID: TR04058
2026-03-30 09:11:54 [auto1.it] INFO: Found listing with ID: NC94766
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC94766%27 HTTP/1.1" 200 None
2026-03-30 09:11:54 [auto1.it] INFO: Scrape type for NC94766: 2
2026-03-30 09:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766
2026-03-30 09:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 678ab250-2141-5cce-a7ad-2903cb78c4c5 with scrape type 2
2026-03-30 09:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 678ab250-2141-5cce-a7ad-2903cb78c4c5 with scrape type 2
2026-03-30 09:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 678ab250-2141-5cce-a7ad-2903cb78c4c5, identifier: NC94766
2026-03-30 09:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766
2026-03-30 09:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766
2026-03-30 09:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 678ab250-2141-5cce-a7ad-2903cb78c4c5 with identifier: NC94766 to the API
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:37:28Z',
 'fuel_type': 'hybrid',
 'id': '678ab250-2141-5cce-a7ad-2903cb78c4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC94766',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 37037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-24',
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Trend',
 'transmission': 'automatic',
 'trim': '2WD Trend',
 'year': 2022}
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC94766%27 HTTP/1.1" 200 None
2026-03-30 09:11:54 [auto1.it] INFO: Saving data for NC94766: {'auction_closing_time': 1774885048.0, 'created_time': 1773131150.49028, 'last_price_update_time': 1774861914.962551}
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NC94766') HTTP/1.1" 204 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: UC76692
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: NT59940
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: KM64603
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM64603%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for KM64603: 2
2026-03-30 09:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2673677-446f-590c-b5e3-9d07e4445179 with identifier: KM64603
2026-03-30 09:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2673677-446f-590c-b5e3-9d07e4445179 with scrape type 2
2026-03-30 09:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2673677-446f-590c-b5e3-9d07e4445179 with scrape type 2
2026-03-30 09:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e2673677-446f-590c-b5e3-9d07e4445179, identifier: KM64603
2026-03-30 09:11:55 [auto1.it] INFO: Channel: 24h | Page: 29 | totalHits: 3312 | hits on page: 40
2026-03-30 09:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e2673677-446f-590c-b5e3-9d07e4445179 with identifier: KM64603
2026-03-30 09:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e2673677-446f-590c-b5e3-9d07e4445179 with identifier: KM64603
2026-03-30 09:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e2673677-446f-590c-b5e3-9d07e4445179 with identifier: KM64603 to the API
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:55Z',
 'fuel_type': 'diesel',
 'id': 'e2673677-446f-590c-b5e3-9d07e4445179',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM64603',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 287630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-02',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2012}
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM64603%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Saving data for KM64603: {'auction_closing_time': 1774883995.0, 'created_time': 1771447072.618698, 'last_price_update_time': 1774861915.462845}
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM64603') HTTP/1.1" 204 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: PA30121
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA30121%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for PA30121: 2
2026-03-30 09:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1796b1d4-381e-50b5-83c3-9b2e2f7547e9 with identifier: PA30121
2026-03-30 09:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1796b1d4-381e-50b5-83c3-9b2e2f7547e9 with scrape type 2
2026-03-30 09:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1796b1d4-381e-50b5-83c3-9b2e2f7547e9 with scrape type 2
2026-03-30 09:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1796b1d4-381e-50b5-83c3-9b2e2f7547e9, identifier: PA30121
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: CR51689
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: PE19282
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: LP93747
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: RA56260
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA56260%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for RA56260: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: EK01014
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK01014%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for EK01014: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: ZH89782
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH89782%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for ZH89782: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: YS46644
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS46644%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for YS46644: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: RC57618
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC57618%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for RC57618: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: RZ13611
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ13611%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for RZ13611: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: TD94995
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: EW86248
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW86248%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for EW86248: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: WB67715
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB67715%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for WB67715: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: ZK23412
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: KT97112
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: VX54409
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX54409%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for VX54409: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: XH11814
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH11814%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for XH11814: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: KN64287
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN64287%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for KN64287: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: JM92552
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: HP20595
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: RF53509
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF53509%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for RF53509: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: VY56093
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: XS81991
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: KL09391
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: DH11119
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: VL58331
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: MW24611
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: WJ42513
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ42513%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for WJ42513: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: RX80413
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX80413%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for RX80413: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: JK04484
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: ZE02722
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE02722%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for ZE02722: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: PA82276
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA82276%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for PA82276: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: XE77432
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE77432%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for XE77432: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: BG27865
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: EK32086
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: VN61969
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN61969%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for VN61969: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: RH32617
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH32617%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for RH32617: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: TJ05076
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: PZ73460
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ73460%27 HTTP/1.1" 200 None
2026-03-30 09:11:55 [auto1.it] INFO: Scrape type for PZ73460: 0
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: TY12720
2026-03-30 09:11:55 [auto1.it] INFO: Found listing with ID: RS94831
2026-03-30 09:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1796b1d4-381e-50b5-83c3-9b2e2f7547e9 with identifier: PA30121
2026-03-30 09:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1796b1d4-381e-50b5-83c3-9b2e2f7547e9 with identifier: PA30121
2026-03-30 09:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1796b1d4-381e-50b5-83c3-9b2e2f7547e9 with identifier: PA30121 to the API
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:45:04Z',
 'fuel_type': 'diesel',
 'id': '1796b1d4-381e-50b5-83c3-9b2e2f7547e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA30121',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 169744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-08',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA30121%27 HTTP/1.1" 200 None
2026-03-30 09:11:56 [auto1.it] INFO: Saving data for PA30121: {'auction_closing_time': 1774885504.0, 'created_time': 1771704544.922787, 'last_price_update_time': 1774861916.269313}
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PA30121') HTTP/1.1" 204 0
2026-03-30 09:11:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: ZY33580
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY33580%27 HTTP/1.1" 200 None
2026-03-30 09:11:56 [auto1.it] INFO: Scrape type for ZY33580: 0
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: YJ83729
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ83729%27 HTTP/1.1" 200 None
2026-03-30 09:11:56 [auto1.it] INFO: Scrape type for YJ83729: 0
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: WL70343
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: DT89557
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: VK83291
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: FR55609
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55609%27 HTTP/1.1" 200 None
2026-03-30 09:11:56 [auto1.it] INFO: Scrape type for FR55609: 0
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: CV87912
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV87912%27 HTTP/1.1" 200 None
2026-03-30 09:11:56 [auto1.it] INFO: Scrape type for CV87912: 0
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: MU13564
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU13564%27 HTTP/1.1" 200 None
2026-03-30 09:11:56 [auto1.it] INFO: Scrape type for MU13564: 0
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: PY58212
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58212%27 HTTP/1.1" 200 None
2026-03-30 09:11:56 [auto1.it] INFO: Scrape type for PY58212: 0
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: NX47141
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX47141%27 HTTP/1.1" 200 None
2026-03-30 09:11:56 [auto1.it] INFO: Scrape type for NX47141: 0
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: SC24235
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC24235%27 HTTP/1.1" 200 None
2026-03-30 09:11:56 [auto1.it] INFO: Scrape type for SC24235: 0
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: WL97433
2026-03-30 09:11:56 [auto1.it] INFO: Found listing with ID: NL26741
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL26741%27 HTTP/1.1" 200 None
2026-03-30 09:11:56 [auto1.it] INFO: Scrape type for NL26741: 0
2026-03-30 09:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:57 [auto1.it] INFO: Channel: 24h | Page: 30 | totalHits: 3311 | hits on page: 40
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: BZ50824
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ50824%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for BZ50824: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: TW69168
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: XK06732
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: CE45515
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE45515%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for CE45515: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: SY67891
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: WE05863
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: KR29976
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: ES96782
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: PU50365
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU50365%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for PU50365: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: NP45555
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP45555%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for NP45555: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: LE11885
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE11885%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for LE11885: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: EW80133
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW80133%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for EW80133: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: DB86833
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: VF83639
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF83639%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for VF83639: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: JP63485
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: PE22085
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: AC12689
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: KK08991
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK08991%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for KK08991: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: NJ15500
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: JU37769
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: LA80285
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: LM41534
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM41534%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for LM41534: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: UK25874
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK25874%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for UK25874: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: PB14031
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: LV20949
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV20949%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for LV20949: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: US42109
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: YD46190
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD46190%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for YD46190: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: BP59545
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: WL47610
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: TE89149
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: KR30691
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: TJ46359
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: WV37243
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV37243%27 HTTP/1.1" 200 None
2026-03-30 09:11:57 [auto1.it] INFO: Scrape type for WV37243: 0
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: LU63689
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: FJ55026
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: GW87454
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: PH50557
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: ZU90701
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: JV01871
2026-03-30 09:11:57 [auto1.it] INFO: Found listing with ID: FS14402
2026-03-30 09:11:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:11:59 [auto1.it] INFO: Channel: 24h | Page: 31 | totalHits: 3311 | hits on page: 40
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: WK43313
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK43313%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for WK43313: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: UV07226
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV07226%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for UV07226: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: DB68692
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: DC45028
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC45028%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for DC45028: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: BD73790
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD73790%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for BD73790: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: SL28261
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL28261%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for SL28261: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: XC65612
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: YD99116
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD99116%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for YD99116: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: PH70338
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH70338%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for PH70338: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: XC79515
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC79515%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for XC79515: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: RS77350
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS77350%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for RS77350: 2
2026-03-30 09:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af306d2a-7594-57d3-9280-d2e7c347500c with identifier: RS77350
2026-03-30 09:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af306d2a-7594-57d3-9280-d2e7c347500c with scrape type 2
2026-03-30 09:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af306d2a-7594-57d3-9280-d2e7c347500c with scrape type 2
2026-03-30 09:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af306d2a-7594-57d3-9280-d2e7c347500c, identifier: RS77350
2026-03-30 09:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af306d2a-7594-57d3-9280-d2e7c347500c with identifier: RS77350
2026-03-30 09:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af306d2a-7594-57d3-9280-d2e7c347500c with identifier: RS77350
2026-03-30 09:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af306d2a-7594-57d3-9280-d2e7c347500c with identifier: RS77350 to the API
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:11:12Z',
 'fuel_type': 'diesel',
 'id': 'af306d2a-7594-57d3-9280-d2e7c347500c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS77350',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 259005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-15',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Attractive',
 'transmission': 'manual',
 'trim': 'Attractive',
 'year': 2011}
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS77350%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Saving data for RS77350: {'auction_closing_time': 1774883472.0, 'created_time': 1774670949.692415, 'last_price_update_time': 1774861919.815389}
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RS77350') HTTP/1.1" 204 0
2026-03-30 09:11:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: NK56802
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: ET21203
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET21203%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for ET21203: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: BG99585
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG99585%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for BG99585: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: HZ70208
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ70208%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for HZ70208: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: JP32854
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP32854%27 HTTP/1.1" 200 None
2026-03-30 09:11:59 [auto1.it] INFO: Scrape type for JP32854: 0
2026-03-30 09:11:59 [auto1.it] INFO: Found listing with ID: FV19054
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV19054%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for FV19054: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: VX82839
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: PT96186
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: PA28005
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: KC73163
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC73163%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for KC73163: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: MN68461
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: YA54300
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA54300%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for YA54300: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: UJ66117
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ66117%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for UJ66117: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: RE99850
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE99850%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for RE99850: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: JP92326
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP92326%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for JP92326: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: CU15371
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU15371%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for CU15371: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: AB01371
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB01371%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for AB01371: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: XB62766
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: TU59296
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59296%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for TU59296: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: FN81856
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: AD01687
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: RM66107
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM66107%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for RM66107: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: CK86990
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK86990%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for CK86990: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: AY12786
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: XD81326
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD81326%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for XD81326: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: ED09945
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: LK74969
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK74969%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for LK74969: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: PW94940
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94940%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for PW94940: 0
2026-03-30 09:12:00 [auto1.it] INFO: Found listing with ID: UH56050
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH56050%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Scrape type for UH56050: 2
2026-03-30 09:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7afd9303-e3f0-5404-a6af-0a0824cc314f with identifier: UH56050
2026-03-30 09:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7afd9303-e3f0-5404-a6af-0a0824cc314f with scrape type 2
2026-03-30 09:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7afd9303-e3f0-5404-a6af-0a0824cc314f with scrape type 2
2026-03-30 09:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7afd9303-e3f0-5404-a6af-0a0824cc314f, identifier: UH56050
2026-03-30 09:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7afd9303-e3f0-5404-a6af-0a0824cc314f with identifier: UH56050
2026-03-30 09:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7afd9303-e3f0-5404-a6af-0a0824cc314f with identifier: UH56050
2026-03-30 09:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7afd9303-e3f0-5404-a6af-0a0824cc314f with identifier: UH56050 to the API
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:41:25Z',
 'fuel_type': 'diesel',
 'id': '7afd9303-e3f0-5404-a6af-0a0824cc314f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH56050',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 120785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-01',
 'seller_name': None,
 'title': 'Toyota Corolla 1.4 D-4D Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2006}
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH56050%27 HTTP/1.1" 200 None
2026-03-30 09:12:00 [auto1.it] INFO: Saving data for UH56050: {'auction_closing_time': 1774885285.0, 'created_time': 1774559550.242539, 'last_price_update_time': 1774861920.652064}
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UH56050') HTTP/1.1" 204 0
2026-03-30 09:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:01 [auto1.it] INFO: Channel: 24h | Page: 32 | totalHits: 3311 | hits on page: 40
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: VX86460
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: WE55630
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE55630%27 HTTP/1.1" 200 None
2026-03-30 09:12:01 [auto1.it] INFO: Scrape type for WE55630: 0
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: LF91623
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF91623%27 HTTP/1.1" 200 None
2026-03-30 09:12:01 [auto1.it] INFO: Scrape type for LF91623: 0
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: XT06455
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT06455%27 HTTP/1.1" 200 None
2026-03-30 09:12:01 [auto1.it] INFO: Scrape type for XT06455: 0
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: DD62614
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD62614%27 HTTP/1.1" 200 None
2026-03-30 09:12:01 [auto1.it] INFO: Scrape type for DD62614: 0
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: BA90157
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: AB06670
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: LV99150
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV99150%27 HTTP/1.1" 200 None
2026-03-30 09:12:01 [auto1.it] INFO: Scrape type for LV99150: 0
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: VC44140
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC44140%27 HTTP/1.1" 200 None
2026-03-30 09:12:01 [auto1.it] INFO: Scrape type for VC44140: 0
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: KV39692
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: UL45556
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: LM08573
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: SG91000
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG91000%27 HTTP/1.1" 200 None
2026-03-30 09:12:01 [auto1.it] INFO: Scrape type for SG91000: 0
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: JP22966
2026-03-30 09:12:01 [auto1.it] INFO: Found listing with ID: AA32249
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA32249%27 HTTP/1.1" 200 None
2026-03-30 09:12:01 [auto1.it] INFO: Scrape type for AA32249: 2
2026-03-30 09:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e663463-1b7e-596a-b808-979eda9ccec4 with identifier: AA32249
2026-03-30 09:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e663463-1b7e-596a-b808-979eda9ccec4 with scrape type 2
2026-03-30 09:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e663463-1b7e-596a-b808-979eda9ccec4 with scrape type 2
2026-03-30 09:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e663463-1b7e-596a-b808-979eda9ccec4, identifier: AA32249
2026-03-30 09:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e663463-1b7e-596a-b808-979eda9ccec4 with identifier: AA32249
2026-03-30 09:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e663463-1b7e-596a-b808-979eda9ccec4 with identifier: AA32249
2026-03-30 09:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3e663463-1b7e-596a-b808-979eda9ccec4 with identifier: AA32249 to the API
2026-03-30 09:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:23:25Z',
 'fuel_type': 'petrol',
 'id': '3e663463-1b7e-596a-b808-979eda9ccec4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA32249',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 169644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-18',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2017}
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA32249%27 HTTP/1.1" 200 None
2026-03-30 09:12:02 [auto1.it] INFO: Saving data for AA32249: {'auction_closing_time': 1774884205.0, 'created_time': 1774559379.869894, 'last_price_update_time': 1774861922.144528}
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AA32249') HTTP/1.1" 204 0
2026-03-30 09:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: CK12538
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: YV19719
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV19719%27 HTTP/1.1" 200 None
2026-03-30 09:12:02 [auto1.it] INFO: Scrape type for YV19719: 2
2026-03-30 09:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec451d09-7f96-5d1c-aee9-b6f928fdff8c with identifier: YV19719
2026-03-30 09:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec451d09-7f96-5d1c-aee9-b6f928fdff8c with scrape type 2
2026-03-30 09:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec451d09-7f96-5d1c-aee9-b6f928fdff8c with scrape type 2
2026-03-30 09:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ec451d09-7f96-5d1c-aee9-b6f928fdff8c, identifier: YV19719
2026-03-30 09:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ec451d09-7f96-5d1c-aee9-b6f928fdff8c with identifier: YV19719
2026-03-30 09:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ec451d09-7f96-5d1c-aee9-b6f928fdff8c with identifier: YV19719
2026-03-30 09:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ec451d09-7f96-5d1c-aee9-b6f928fdff8c with identifier: YV19719 to the API
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:21:10Z',
 'fuel_type': 'diesel',
 'id': 'ec451d09-7f96-5d1c-aee9-b6f928fdff8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV19719',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 365430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-23',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Advanced',
 'transmission': 'manual',
 'trim': 'Advanced',
 'year': 2013}
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV19719%27 HTTP/1.1" 200 None
2026-03-30 09:12:02 [auto1.it] INFO: Saving data for YV19719: {'auction_closing_time': 1774884070.0, 'created_time': 1774559407.522786, 'last_price_update_time': 1774861922.644122}
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YV19719') HTTP/1.1" 204 0
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: PW56521
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: CX68845
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: SV37675
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: BF69187
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: ZZ46834
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ46834%27 HTTP/1.1" 200 None
2026-03-30 09:12:02 [auto1.it] INFO: Scrape type for ZZ46834: 0
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: EV65529
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV65529%27 HTTP/1.1" 200 None
2026-03-30 09:12:02 [auto1.it] INFO: Scrape type for EV65529: 0
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: YW82008
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW82008%27 HTTP/1.1" 200 None
2026-03-30 09:12:02 [auto1.it] INFO: Scrape type for YW82008: 0
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: TH21432
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: MH72386
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH72386%27 HTTP/1.1" 200 None
2026-03-30 09:12:02 [auto1.it] INFO: Scrape type for MH72386: 0
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: CR81411
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: YF20115
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: NN80859
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: CX56381
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX56381%27 HTTP/1.1" 200 None
2026-03-30 09:12:02 [auto1.it] INFO: Scrape type for CX56381: 0
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: FB75949
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB75949%27 HTTP/1.1" 200 None
2026-03-30 09:12:02 [auto1.it] INFO: Scrape type for FB75949: 0
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: JA23612
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: EM60693
2026-03-30 09:12:02 [auto1.it] INFO: Found listing with ID: LC51604
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC51604%27 HTTP/1.1" 200 None
2026-03-30 09:12:02 [auto1.it] INFO: Scrape type for LC51604: 2
2026-03-30 09:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead5da2b-f0e7-5d88-a9f8-66bbbd886346 with identifier: LC51604
2026-03-30 09:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead5da2b-f0e7-5d88-a9f8-66bbbd886346 with scrape type 2
2026-03-30 09:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ead5da2b-f0e7-5d88-a9f8-66bbbd886346 with scrape type 2
2026-03-30 09:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ead5da2b-f0e7-5d88-a9f8-66bbbd886346, identifier: LC51604
2026-03-30 09:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ead5da2b-f0e7-5d88-a9f8-66bbbd886346 with identifier: LC51604
2026-03-30 09:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ead5da2b-f0e7-5d88-a9f8-66bbbd886346 with identifier: LC51604
2026-03-30 09:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ead5da2b-f0e7-5d88-a9f8-66bbbd886346 with identifier: LC51604 to the API
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:12:42Z',
 'fuel_type': 'petrol',
 'id': 'ead5da2b-f0e7-5d88-a9f8-66bbbd886346',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC51604',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 14976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-28',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Xpossible 2WD',
 'transmission': 'manual',
 'trim': 'Xpossible 2WD',
 'year': 2017}
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC51604%27 HTTP/1.1" 200 None
2026-03-30 09:12:03 [auto1.it] INFO: Saving data for LC51604: {'auction_closing_time': 1774883562.0, 'created_time': 1774559245.071855, 'last_price_update_time': 1774861923.210844}
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC51604') HTTP/1.1" 204 0
2026-03-30 09:12:03 [auto1.it] INFO: Found listing with ID: UK70353
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK70353%27 HTTP/1.1" 200 None
2026-03-30 09:12:03 [auto1.it] INFO: Scrape type for UK70353: 0
2026-03-30 09:12:03 [auto1.it] INFO: Found listing with ID: KM71175
2026-03-30 09:12:03 [auto1.it] INFO: Found listing with ID: AE34833
2026-03-30 09:12:03 [auto1.it] INFO: Found listing with ID: PB29949
2026-03-30 09:12:03 [auto1.it] INFO: Found listing with ID: AU35917
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU35917%27 HTTP/1.1" 200 None
2026-03-30 09:12:03 [auto1.it] INFO: Scrape type for AU35917: 0
2026-03-30 09:12:03 [auto1.it] INFO: Found listing with ID: DR37659
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR37659%27 HTTP/1.1" 200 None
2026-03-30 09:12:03 [auto1.it] INFO: Scrape type for DR37659: 0
2026-03-30 09:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:04 [scrapy.extensions.logstats] INFO: Crawled 285 pages (at 16 pages/min), scraped 546 items (at 101 items/min)
2026-03-30 09:12:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 09:12:04 [auto1.it] INFO: Channel: 24h | Page: 33 | totalHits: 3312 | hits on page: 40
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: DR37659
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR37659%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for DR37659: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: WY72750
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: LC01017
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC01017%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for LC01017: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: MW60739
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW60739%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for MW60739: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: XH41983
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH41983%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for XH41983: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: RR03246
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR03246%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for RR03246: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: HY79670
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY79670%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for HY79670: 2
2026-03-30 09:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6986e9aa-4dc7-54af-add7-db36308c2828 with identifier: HY79670
2026-03-30 09:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6986e9aa-4dc7-54af-add7-db36308c2828 with scrape type 2
2026-03-30 09:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6986e9aa-4dc7-54af-add7-db36308c2828 with scrape type 2
2026-03-30 09:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6986e9aa-4dc7-54af-add7-db36308c2828, identifier: HY79670
2026-03-30 09:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6986e9aa-4dc7-54af-add7-db36308c2828 with identifier: HY79670
2026-03-30 09:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6986e9aa-4dc7-54af-add7-db36308c2828 with identifier: HY79670
2026-03-30 09:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6986e9aa-4dc7-54af-add7-db36308c2828 with identifier: HY79670 to the API
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:22:46Z',
 'fuel_type': 'diesel',
 'id': '6986e9aa-4dc7-54af-add7-db36308c2828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY79670',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 256510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-17',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2012}
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY79670%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Saving data for HY79670: {'auction_closing_time': 1774884166.0, 'created_time': 1774559506.268689, 'last_price_update_time': 1774861924.710632}
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY79670') HTTP/1.1" 204 0
2026-03-30 09:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: EC99785
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC99785%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for EC99785: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: MB50671
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB50671%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for MB50671: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: JF90456
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: LL94615
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL94615%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for LL94615: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: WZ44056
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: DC03945
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC03945%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for DC03945: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: BH62739
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: LR71348
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: ML20734
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML20734%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for ML20734: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: HC48656
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: CZ22961
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ22961%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for CZ22961: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: RM05411
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: VS31933
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: ZC19416
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC19416%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for ZC19416: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: GN54162
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: DE25222
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: YL89014
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: MA77848
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA77848%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for MA77848: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: CF61926
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF61926%27 HTTP/1.1" 200 None
2026-03-30 09:12:04 [auto1.it] INFO: Scrape type for CF61926: 0
2026-03-30 09:12:04 [auto1.it] INFO: Found listing with ID: HD82423
2026-03-30 09:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD82423%27 HTTP/1.1" 200 None
2026-03-30 09:12:05 [auto1.it] INFO: Scrape type for HD82423: 0
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: MU03817
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: ZS54460
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: AY21125
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21125%27 HTTP/1.1" 200 None
2026-03-30 09:12:05 [auto1.it] INFO: Scrape type for AY21125: 2
2026-03-30 09:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a2b2a70-9be8-531a-a71a-b64f98c2e57c with identifier: AY21125
2026-03-30 09:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a2b2a70-9be8-531a-a71a-b64f98c2e57c with scrape type 2
2026-03-30 09:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a2b2a70-9be8-531a-a71a-b64f98c2e57c with scrape type 2
2026-03-30 09:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a2b2a70-9be8-531a-a71a-b64f98c2e57c, identifier: AY21125
2026-03-30 09:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a2b2a70-9be8-531a-a71a-b64f98c2e57c with identifier: AY21125
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 09:12:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 09:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a2b2a70-9be8-531a-a71a-b64f98c2e57c with identifier: AY21125
2026-03-30 09:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a2b2a70-9be8-531a-a71a-b64f98c2e57c with identifier: AY21125 to the API
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:17Z',
 'fuel_type': 'petrol',
 'id': '4a2b2a70-9be8-531a-a71a-b64f98c2e57c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY21125',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 681041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-17',
 'seller_name': None,
 'title': 'Fiat Doblo 1.4 Turbo Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2013}
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21125%27 HTTP/1.1" 200 None
2026-03-30 09:12:05 [auto1.it] INFO: Saving data for AY21125: {'auction_closing_time': 1774884917.0, 'created_time': 1774559479.029456, 'last_price_update_time': 1774861925.567873}
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AY21125') HTTP/1.1" 204 0
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: NW60366
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW60366%27 HTTP/1.1" 200 None
2026-03-30 09:12:05 [auto1.it] INFO: Scrape type for NW60366: 0
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: XR42745
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: WV42889
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV42889%27 HTTP/1.1" 200 None
2026-03-30 09:12:05 [auto1.it] INFO: Scrape type for WV42889: 0
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: UE31204
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: KD02463
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: SL86512
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL86512%27 HTTP/1.1" 200 None
2026-03-30 09:12:05 [auto1.it] INFO: Scrape type for SL86512: 0
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: EZ48642
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ48642%27 HTTP/1.1" 200 None
2026-03-30 09:12:05 [auto1.it] INFO: Scrape type for EZ48642: 0
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: BM42520
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: SG31590
2026-03-30 09:12:05 [auto1.it] INFO: Found listing with ID: DN82434
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN82434%27 HTTP/1.1" 200 None
2026-03-30 09:12:05 [auto1.it] INFO: Scrape type for DN82434: 0
2026-03-30 09:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:06 [auto1.it] INFO: Channel: 24h | Page: 34 | totalHits: 3312 | hits on page: 40
2026-03-30 09:12:06 [auto1.it] INFO: Found listing with ID: AN97971
2026-03-30 09:12:06 [auto1.it] INFO: Found listing with ID: FP35914
2026-03-30 09:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP35914%27 HTTP/1.1" 200 None
2026-03-30 09:12:06 [auto1.it] INFO: Scrape type for FP35914: 0
2026-03-30 09:12:06 [auto1.it] INFO: Found listing with ID: RK20934
2026-03-30 09:12:06 [auto1.it] INFO: Found listing with ID: ZY56429
2026-03-30 09:12:06 [auto1.it] INFO: Found listing with ID: XN27965
2026-03-30 09:12:06 [auto1.it] INFO: Found listing with ID: VF40015
2026-03-30 09:12:06 [auto1.it] INFO: Found listing with ID: EC84941
2026-03-30 09:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC84941%27 HTTP/1.1" 200 None
2026-03-30 09:12:06 [auto1.it] INFO: Scrape type for EC84941: 2
2026-03-30 09:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45da975c-b0e5-59dc-9030-7f4b8f3c2b4a with identifier: EC84941
2026-03-30 09:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45da975c-b0e5-59dc-9030-7f4b8f3c2b4a with scrape type 2
2026-03-30 09:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45da975c-b0e5-59dc-9030-7f4b8f3c2b4a with scrape type 2
2026-03-30 09:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 45da975c-b0e5-59dc-9030-7f4b8f3c2b4a, identifier: EC84941
2026-03-30 09:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 45da975c-b0e5-59dc-9030-7f4b8f3c2b4a with identifier: EC84941
2026-03-30 09:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 45da975c-b0e5-59dc-9030-7f4b8f3c2b4a with identifier: EC84941
2026-03-30 09:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 45da975c-b0e5-59dc-9030-7f4b8f3c2b4a with identifier: EC84941 to the API
2026-03-30 09:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:48:00Z',
 'fuel_type': 'petrol',
 'id': '45da975c-b0e5-59dc-9030-7f4b8f3c2b4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC84941',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 5714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-12',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Tech',
 'transmission': 'manual',
 'trim': 'Tech',
 'year': 2022}
2026-03-30 09:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC84941%27 HTTP/1.1" 200 None
2026-03-30 09:12:06 [auto1.it] INFO: Saving data for EC84941: {'auction_closing_time': 1774885680.0, 'created_time': 1774343155.74465, 'last_price_update_time': 1774861926.945523}
2026-03-30 09:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC84941') HTTP/1.1" 204 0
2026-03-30 09:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: JJ80566
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ80566%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for JJ80566: 2
2026-03-30 09:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ffec4f0-014f-5a2e-8a09-cef92c6fb365 with identifier: JJ80566
2026-03-30 09:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ffec4f0-014f-5a2e-8a09-cef92c6fb365 with scrape type 2
2026-03-30 09:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ffec4f0-014f-5a2e-8a09-cef92c6fb365 with scrape type 2
2026-03-30 09:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ffec4f0-014f-5a2e-8a09-cef92c6fb365, identifier: JJ80566
2026-03-30 09:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ffec4f0-014f-5a2e-8a09-cef92c6fb365 with identifier: JJ80566
2026-03-30 09:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ffec4f0-014f-5a2e-8a09-cef92c6fb365 with identifier: JJ80566
2026-03-30 09:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ffec4f0-014f-5a2e-8a09-cef92c6fb365 with identifier: JJ80566 to the API
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:51:02Z',
 'fuel_type': 'diesel',
 'id': '8ffec4f0-014f-5a2e-8a09-cef92c6fb365',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ80566',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 201896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-29',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2016}
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ80566%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Saving data for JJ80566: {'auction_closing_time': 1774885862.0, 'created_time': 1774559417.108666, 'last_price_update_time': 1774861927.457129}
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JJ80566') HTTP/1.1" 204 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: RL33082
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL33082%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for RL33082: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: EB44431
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: JF75950
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF75950%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for JF75950: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: WX88611
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX88611%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for WX88611: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: FA16942
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA16942%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for FA16942: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: NH64941
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: KS43685
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS43685%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for KS43685: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: FE11339
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: TS34792
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: RY64752
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY64752%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for RY64752: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: CS00409
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: ET79230
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: HD95534
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: KL55117
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: CH57446
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH57446%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for CH57446: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: KB12646
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB12646%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for KB12646: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: NC67394
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC67394%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for NC67394: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: ZD65765
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: WM00919
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM00919%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for WM00919: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: UR83709
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR83709%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for UR83709: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: XJ91749
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ91749%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for XJ91749: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: RZ16714
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: JB13262
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB13262%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for JB13262: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: TU38446
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU38446%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for TU38446: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: AR28136
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR28136%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for AR28136: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: EV19228
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV19228%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for EV19228: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: CN88471
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: XX59557
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: EH45262
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH45262%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for EH45262: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: BV63915
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV63915%27 HTTP/1.1" 200 None
2026-03-30 09:12:07 [auto1.it] INFO: Scrape type for BV63915: 0
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: TH28502
2026-03-30 09:12:07 [auto1.it] INFO: Found listing with ID: KS79524
2026-03-30 09:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:08 [auto1.it] INFO: Channel: 24h | Page: 35 | totalHits: 3312 | hits on page: 40
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: JU83939
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU83939%27 HTTP/1.1" 200 None
2026-03-30 09:12:08 [auto1.it] INFO: Scrape type for JU83939: 0
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: CN85628
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: WD53289
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: SE27388
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: FT94062
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT94062%27 HTTP/1.1" 200 None
2026-03-30 09:12:08 [auto1.it] INFO: Scrape type for FT94062: 0
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: NX73202
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: DV90531
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: PW65105
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: TT80777
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: BR63865
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: LX11958
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX11958%27 HTTP/1.1" 200 None
2026-03-30 09:12:08 [auto1.it] INFO: Scrape type for LX11958: 0
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: PA53057
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA53057%27 HTTP/1.1" 200 None
2026-03-30 09:12:08 [auto1.it] INFO: Scrape type for PA53057: 0
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: XW51036
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: RJ33574
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: DW12322
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW12322%27 HTTP/1.1" 200 None
2026-03-30 09:12:08 [auto1.it] INFO: Scrape type for DW12322: 0
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: RT39388
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: ET07404
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: ZR50624
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: GM86126
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM86126%27 HTTP/1.1" 200 None
2026-03-30 09:12:08 [auto1.it] INFO: Scrape type for GM86126: 0
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: WH19380
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: GF15997
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF15997%27 HTTP/1.1" 200 None
2026-03-30 09:12:08 [auto1.it] INFO: Scrape type for GF15997: 0
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: MS58907
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: DA24771
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: LE49462
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: LR70211
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: AL22636
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL22636%27 HTTP/1.1" 200 None
2026-03-30 09:12:08 [auto1.it] INFO: Scrape type for AL22636: 0
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: JT08977
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: MF61265
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MF61265%27 HTTP/1.1" 200 None
2026-03-30 09:12:08 [auto1.it] INFO: Scrape type for MF61265: 0
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: ZX69560
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX69560%27 HTTP/1.1" 200 None
2026-03-30 09:12:08 [auto1.it] INFO: Scrape type for ZX69560: 0
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: ZC80598
2026-03-30 09:12:08 [auto1.it] INFO: Found listing with ID: EG89993
2026-03-30 09:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG89993%27 HTTP/1.1" 200 None
2026-03-30 09:12:09 [auto1.it] INFO: Scrape type for EG89993: 0
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: CB33793
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB33793%27 HTTP/1.1" 200 None
2026-03-30 09:12:09 [auto1.it] INFO: Scrape type for CB33793: 0
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: KJ52341
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: MH68095
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH68095%27 HTTP/1.1" 200 None
2026-03-30 09:12:09 [auto1.it] INFO: Scrape type for MH68095: 0
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: DN48840
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: KD49699
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: HC25835
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC25835%27 HTTP/1.1" 200 None
2026-03-30 09:12:09 [auto1.it] INFO: Scrape type for HC25835: 0
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: VZ70094
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: FZ95983
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: KR95959
2026-03-30 09:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:09 [auto1.it] INFO: Channel: 24h | Page: 36 | totalHits: 3312 | hits on page: 40
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: RD83320
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD83320%27 HTTP/1.1" 200 None
2026-03-30 09:12:09 [auto1.it] INFO: Scrape type for RD83320: 0
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: GP15834
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: KD20323
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD20323%27 HTTP/1.1" 200 None
2026-03-30 09:12:09 [auto1.it] INFO: Scrape type for KD20323: 0
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: HP12790
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: KT78402
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT78402%27 HTTP/1.1" 200 None
2026-03-30 09:12:09 [auto1.it] INFO: Scrape type for KT78402: 0
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: TZ23741
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ23741%27 HTTP/1.1" 200 None
2026-03-30 09:12:09 [auto1.it] INFO: Scrape type for TZ23741: 0
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: XT36875
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT36875%27 HTTP/1.1" 200 None
2026-03-30 09:12:09 [auto1.it] INFO: Scrape type for XT36875: 0
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: ZL03111
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: NC12493
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC12493%27 HTTP/1.1" 200 None
2026-03-30 09:12:09 [auto1.it] INFO: Scrape type for NC12493: 0
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: TL13450
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: ZP73975
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP73975%27 HTTP/1.1" 200 None
2026-03-30 09:12:09 [auto1.it] INFO: Scrape type for ZP73975: 0
2026-03-30 09:12:09 [auto1.it] INFO: Found listing with ID: BT65910
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT65910%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for BT65910: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: AY77506
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY77506%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for AY77506: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: TW94655
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: ED22447
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED22447%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for ED22447: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: KZ49625
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ49625%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for KZ49625: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: XM03029
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: PZ63395
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ63395%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for PZ63395: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: TY62021
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY62021%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for TY62021: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: CW24266
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW24266%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for CW24266: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: LX97199
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: BR49145
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR49145%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for BR49145: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: CT62115
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT62115%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for CT62115: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: ND06570
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND06570%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for ND06570: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: FX03621
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX03621%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for FX03621: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: BX57696
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: SS09351
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS09351%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for SS09351: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: PW70389
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW70389%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for PW70389: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: DA57942
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: MJ97902
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ97902%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for MJ97902: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: EZ75087
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: BR31613
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR31613%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for BR31613: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: FH51436
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH51436%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for FH51436: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: FX08227
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX08227%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for FX08227: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: AU78491
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU78491%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for AU78491: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: ST39288
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: ZY63215
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY63215%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for ZY63215: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: TH24600
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH24600%27 HTTP/1.1" 200 None
2026-03-30 09:12:10 [auto1.it] INFO: Scrape type for TH24600: 0
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: HD23157
2026-03-30 09:12:10 [auto1.it] INFO: Found listing with ID: EA21012
2026-03-30 09:12:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:11 [auto1.it] INFO: Channel: 24h | Page: 37 | totalHits: 3312 | hits on page: 40
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: JZ39412
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: UD54750
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD54750%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for UD54750: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: GN89134
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: SP76824
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP76824%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for SP76824: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: TU52552
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: NT95206
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: LK41226
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK41226%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for LK41226: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: UC24034
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: ZW62743
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: SK49323
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK49323%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for SK49323: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: YG84271
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG84271%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for YG84271: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: MZ19905
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: SF43415
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: DW53696
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW53696%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for DW53696: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: SV52525
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: HG71843
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG71843%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for HG71843: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: VX04337
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: NF97325
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: DD82932
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD82932%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for DD82932: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: SY54017
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: FK85417
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK85417%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for FK85417: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: RN99841
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN99841%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for RN99841: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: CP55584
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP55584%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for CP55584: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: GK72900
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK72900%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for GK72900: 0
2026-03-30 09:12:11 [auto1.it] INFO: Found listing with ID: JR96571
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR96571%27 HTTP/1.1" 200 None
2026-03-30 09:12:11 [auto1.it] INFO: Scrape type for JR96571: 2
2026-03-30 09:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b2f6786-c62d-5c2f-b027-9c82d76d83b5 with identifier: JR96571
2026-03-30 09:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b2f6786-c62d-5c2f-b027-9c82d76d83b5 with scrape type 2
2026-03-30 09:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b2f6786-c62d-5c2f-b027-9c82d76d83b5 with scrape type 2
2026-03-30 09:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b2f6786-c62d-5c2f-b027-9c82d76d83b5, identifier: JR96571
2026-03-30 09:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b2f6786-c62d-5c2f-b027-9c82d76d83b5 with identifier: JR96571
2026-03-30 09:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b2f6786-c62d-5c2f-b027-9c82d76d83b5 with identifier: JR96571
2026-03-30 09:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b2f6786-c62d-5c2f-b027-9c82d76d83b5 with identifier: JR96571 to the API
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:46:53Z',
 'fuel_type': 'diesel',
 'id': '6b2f6786-c62d-5c2f-b027-9c82d76d83b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR96571',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 316627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Executive',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Executive',
 'year': 2013}
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR96571%27 HTTP/1.1" 200 None
2026-03-30 09:12:12 [auto1.it] INFO: Saving data for JR96571: {'auction_closing_time': 1774885613.0, 'created_time': 1774559393.144531, 'last_price_update_time': 1774861932.533249}
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JR96571') HTTP/1.1" 204 0
2026-03-30 09:12:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: YZ66981
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: FR96632
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: TU01190
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: HE91199
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: YG22381
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: CK25903
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: XN45534
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN45534%27 HTTP/1.1" 200 None
2026-03-30 09:12:12 [auto1.it] INFO: Scrape type for XN45534: 0
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: EC13131
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC13131%27 HTTP/1.1" 200 None
2026-03-30 09:12:12 [auto1.it] INFO: Scrape type for EC13131: 0
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: CS14469
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS14469%27 HTTP/1.1" 200 None
2026-03-30 09:12:12 [auto1.it] INFO: Scrape type for CS14469: 0
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: VR70375
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR70375%27 HTTP/1.1" 200 None
2026-03-30 09:12:12 [auto1.it] INFO: Scrape type for VR70375: 0
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: WS86957
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: NC51724
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: BE49358
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: BD99197
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD99197%27 HTTP/1.1" 200 None
2026-03-30 09:12:12 [auto1.it] INFO: Scrape type for BD99197: 0
2026-03-30 09:12:12 [auto1.it] INFO: Found listing with ID: EN53386
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN53386%27 HTTP/1.1" 200 None
2026-03-30 09:12:12 [auto1.it] INFO: Scrape type for EN53386: 0
2026-03-30 09:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:14 [auto1.it] INFO: Channel: 24h | Page: 38 | totalHits: 3312 | hits on page: 40
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: LX30829
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: TJ19111
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ19111%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for TJ19111: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: KX10481
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX10481%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for KX10481: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: EW42527
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW42527%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for EW42527: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: AC58297
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: SK41395
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: YD65292
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: RG08819
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: GB22303
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB22303%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for GB22303: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: VU11306
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU11306%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for VU11306: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: JD40027
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD40027%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for JD40027: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: KF78303
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF78303%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for KF78303: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: BH88586
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: TY97368
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY97368%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for TY97368: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: RL62360
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: LG34418
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: SK90576
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK90576%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for SK90576: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: MT68027
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: GU05332
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: AN40699
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: CK01527
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: WW70884
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW70884%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for WW70884: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: AT74871
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT74871%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for AT74871: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: BJ21664
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: FP22884
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP22884%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for FP22884: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: SN99997
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: YL87875
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: SP92634
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: AH31892
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: FH04610
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH04610%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for FH04610: 2
2026-03-30 09:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58354375-8c0b-5f1a-a757-9cceac760ba0 with identifier: FH04610
2026-03-30 09:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58354375-8c0b-5f1a-a757-9cceac760ba0 with scrape type 2
2026-03-30 09:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58354375-8c0b-5f1a-a757-9cceac760ba0 with scrape type 2
2026-03-30 09:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 58354375-8c0b-5f1a-a757-9cceac760ba0, identifier: FH04610
2026-03-30 09:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 58354375-8c0b-5f1a-a757-9cceac760ba0 with identifier: FH04610
2026-03-30 09:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 58354375-8c0b-5f1a-a757-9cceac760ba0 with identifier: FH04610
2026-03-30 09:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 58354375-8c0b-5f1a-a757-9cceac760ba0 with identifier: FH04610 to the API
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:32:58Z',
 'fuel_type': 'petrol',
 'id': '58354375-8c0b-5f1a-a757-9cceac760ba0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH04610',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 221529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-05',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2007}
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH04610%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Saving data for FH04610: {'auction_closing_time': 1774884778.0, 'created_time': 1774559434.886272, 'last_price_update_time': 1774861934.752315}
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FH04610') HTTP/1.1" 204 0
2026-03-30 09:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: ZE89719
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: RE87143
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: PU90509
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: TG60202
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG60202%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for TG60202: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: BJ73113
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: TX50484
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX50484%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for TX50484: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: JU23021
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: DE48831
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: PG69305
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG69305%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for PG69305: 0
2026-03-30 09:12:14 [auto1.it] INFO: Found listing with ID: JS62412
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS62412%27 HTTP/1.1" 200 None
2026-03-30 09:12:14 [auto1.it] INFO: Scrape type for JS62412: 0
2026-03-30 09:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:16 [auto1.it] INFO: Channel: 24h | Page: 39 | totalHits: 3313 | hits on page: 40
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: JS62412
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS62412%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for JS62412: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: RW64625
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: WX67440
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX67440%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for WX67440: 2
2026-03-30 09:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f63acba1-8d78-5a3e-a157-c93c5eaa3d39 with identifier: WX67440
2026-03-30 09:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f63acba1-8d78-5a3e-a157-c93c5eaa3d39 with scrape type 2
2026-03-30 09:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f63acba1-8d78-5a3e-a157-c93c5eaa3d39 with scrape type 2
2026-03-30 09:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f63acba1-8d78-5a3e-a157-c93c5eaa3d39, identifier: WX67440
2026-03-30 09:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f63acba1-8d78-5a3e-a157-c93c5eaa3d39 with identifier: WX67440
2026-03-30 09:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f63acba1-8d78-5a3e-a157-c93c5eaa3d39 with identifier: WX67440
2026-03-30 09:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f63acba1-8d78-5a3e-a157-c93c5eaa3d39 with identifier: WX67440 to the API
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:17:10Z',
 'fuel_type': 'diesel',
 'id': 'f63acba1-8d78-5a3e-a157-c93c5eaa3d39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX67440',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 138909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-31',
 'seller_name': None,
 'title': 'BMW 5er 530d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX67440%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Saving data for WX67440: {'auction_closing_time': 1774883830.0, 'created_time': 1774559506.610374, 'last_price_update_time': 1774861936.533423}
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WX67440') HTTP/1.1" 204 0
2026-03-30 09:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: ZR26877
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: SE55523
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE55523%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for SE55523: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: YF34065
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: CV31826
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV31826%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for CV31826: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: MN82158
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: TK22539
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: NW47878
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW47878%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for NW47878: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: XY34648
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY34648%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for XY34648: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: NJ83998
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: TZ83635
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: WH83035
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: XJ39556
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: PG99334
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: BC39052
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: HS01763
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS01763%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for HS01763: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: HY24657
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: TL14575
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: KB32662
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB32662%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for KB32662: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: RC58822
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: GX95672
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX95672%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for GX95672: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: FT43083
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT43083%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for FT43083: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: KW54926
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: GD67829
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD67829%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for GD67829: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: NC97185
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: MH53431
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH53431%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for MH53431: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: CW25523
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: XR70694
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: MS98879
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: XM00417
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: GW90153
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: HZ95408
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ95408%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for HZ95408: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: EK65593
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: TT44801
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT44801%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for TT44801: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: ZV86353
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: CU49337
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU49337%27 HTTP/1.1" 200 None
2026-03-30 09:12:16 [auto1.it] INFO: Scrape type for CU49337: 0
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: AG84200
2026-03-30 09:12:16 [auto1.it] INFO: Found listing with ID: YX87347
2026-03-30 09:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:18 [auto1.it] INFO: Channel: 24h | Page: 40 | totalHits: 3313 | hits on page: 40
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: UW94573
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: WN29902
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: GA39078
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA39078%27 HTTP/1.1" 200 None
2026-03-30 09:12:18 [auto1.it] INFO: Scrape type for GA39078: 0
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: HF24893
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF24893%27 HTTP/1.1" 200 None
2026-03-30 09:12:18 [auto1.it] INFO: Scrape type for HF24893: 0
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: KZ16799
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ16799%27 HTTP/1.1" 200 None
2026-03-30 09:12:18 [auto1.it] INFO: Scrape type for KZ16799: 0
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: SR16589
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR16589%27 HTTP/1.1" 200 None
2026-03-30 09:12:18 [auto1.it] INFO: Scrape type for SR16589: 2
2026-03-30 09:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bd01b35-f497-5ae3-ad8e-31788d6ed469 with identifier: SR16589
2026-03-30 09:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bd01b35-f497-5ae3-ad8e-31788d6ed469 with scrape type 2
2026-03-30 09:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bd01b35-f497-5ae3-ad8e-31788d6ed469 with scrape type 2
2026-03-30 09:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4bd01b35-f497-5ae3-ad8e-31788d6ed469, identifier: SR16589
2026-03-30 09:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4bd01b35-f497-5ae3-ad8e-31788d6ed469 with identifier: SR16589
2026-03-30 09:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4bd01b35-f497-5ae3-ad8e-31788d6ed469 with identifier: SR16589
2026-03-30 09:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4bd01b35-f497-5ae3-ad8e-31788d6ed469 with identifier: SR16589 to the API
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:23:56Z',
 'fuel_type': 'petrol',
 'id': '4bd01b35-f497-5ae3-ad8e-31788d6ed469',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR16589',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 44750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-26',
 'seller_name': None,
 'title': 'Opel Karl 1.0 120 Jahre Start/Stop',
 'transmission': 'manual',
 'trim': '120 Jahre Start/Stop',
 'year': 2019}
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR16589%27 HTTP/1.1" 200 None
2026-03-30 09:12:18 [auto1.it] INFO: Saving data for SR16589: {'auction_closing_time': 1774884236.0, 'created_time': 1774559320.164252, 'last_price_update_time': 1774861938.756209}
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SR16589') HTTP/1.1" 204 0
2026-03-30 09:12:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: NL55256
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL55256%27 HTTP/1.1" 200 None
2026-03-30 09:12:18 [auto1.it] INFO: Scrape type for NL55256: 0
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: VN35608
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: FZ10631
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ10631%27 HTTP/1.1" 200 None
2026-03-30 09:12:18 [auto1.it] INFO: Scrape type for FZ10631: 0
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: YT67370
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: LC36038
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: UF75242
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: EC29909
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: PE07911
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: XD70855
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-03-30 09:12:18 [auto1.it] INFO: Scrape type for XD70855: 0
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: JW87652
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW87652%27 HTTP/1.1" 200 None
2026-03-30 09:12:18 [auto1.it] INFO: Scrape type for JW87652: 0
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: RF52556
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: NC90447
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: KC88615
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: GC55004
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: TV99764
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV99764%27 HTTP/1.1" 200 None
2026-03-30 09:12:18 [auto1.it] INFO: Scrape type for TV99764: 0
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: ZG57893
2026-03-30 09:12:18 [auto1.it] INFO: Found listing with ID: YG18020
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG18020%27 HTTP/1.1" 200 None
2026-03-30 09:12:19 [auto1.it] INFO: Scrape type for YG18020: 0
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: WH55866
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH55866%27 HTTP/1.1" 200 None
2026-03-30 09:12:19 [auto1.it] INFO: Scrape type for WH55866: 0
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: FD29696
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: HD54235
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD54235%27 HTTP/1.1" 200 None
2026-03-30 09:12:19 [auto1.it] INFO: Scrape type for HD54235: 0
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: GT76958
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT76958%27 HTTP/1.1" 200 None
2026-03-30 09:12:19 [auto1.it] INFO: Scrape type for GT76958: 0
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: NH73732
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH73732%27 HTTP/1.1" 200 None
2026-03-30 09:12:19 [auto1.it] INFO: Scrape type for NH73732: 0
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: EZ12960
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: EZ73351
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: PM88021
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: GT16338
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT16338%27 HTTP/1.1" 200 None
2026-03-30 09:12:19 [auto1.it] INFO: Scrape type for GT16338: 0
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: WZ40427
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: WV44347
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: FH81414
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH81414%27 HTTP/1.1" 200 None
2026-03-30 09:12:19 [auto1.it] INFO: Scrape type for FH81414: 0
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: NM56587
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: AP78180
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: RC69852
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: XB17509
2026-03-30 09:12:19 [auto1.it] INFO: Found listing with ID: DW69714
2026-03-30 09:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:20 [auto1.it] INFO: Channel: 24h | Page: 41 | totalHits: 3313 | hits on page: 40
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: DS58810
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS58810%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for DS58810: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: JC86695
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: SE79185
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE79185%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for SE79185: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: HN90303
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN90303%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for HN90303: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: GT17675
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT17675%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for GT17675: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: JT48153
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT48153%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for JT48153: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: PD12623
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD12623%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for PD12623: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: KT77401
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: UC06691
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: ED34625
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: JN59652
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: FZ12921
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: JB83291
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: TL40655
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL40655%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for TL40655: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: LG12773
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG12773%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for LG12773: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: ST64226
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: KZ84746
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: FT05147
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: LE96160
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE96160%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for LE96160: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: SV71044
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV71044%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for SV71044: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: XL03216
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: ZW92714
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: DR27432
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: HS22715
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS22715%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for HS22715: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: GL53946
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL53946%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for GL53946: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: SC05419
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05419%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for SC05419: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: TC64761
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: XU52863
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: UC13059
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC13059%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for UC13059: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: WB86834
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB86834%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for WB86834: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: FF76752
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF76752%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for FF76752: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: WU65183
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: HK62879
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK62879%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for HK62879: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: PR79135
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR79135%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for PR79135: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: GX06628
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: BR31309
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR31309%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for BR31309: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: XW11641
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW11641%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for XW11641: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: LR54413
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR54413%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for LR54413: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: FF49180
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF49180%27 HTTP/1.1" 200 None
2026-03-30 09:12:20 [auto1.it] INFO: Scrape type for FF49180: 0
2026-03-30 09:12:20 [auto1.it] INFO: Found listing with ID: CD07087
2026-03-30 09:12:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:21 [auto1.it] INFO: Channel: 24h | Page: 42 | totalHits: 3313 | hits on page: 40
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: TZ83708
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: UE17288
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: CS05902
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS05902%27 HTTP/1.1" 200 None
2026-03-30 09:12:21 [auto1.it] INFO: Scrape type for CS05902: 0
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: VB70261
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: ZV11200
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV11200%27 HTTP/1.1" 200 None
2026-03-30 09:12:21 [auto1.it] INFO: Scrape type for ZV11200: 0
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: DA61571
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA61571%27 HTTP/1.1" 200 None
2026-03-30 09:12:21 [auto1.it] INFO: Scrape type for DA61571: 0
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: DX02178
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: YG03340
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG03340%27 HTTP/1.1" 200 None
2026-03-30 09:12:21 [auto1.it] INFO: Scrape type for YG03340: 0
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: FF98619
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: YP32890
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: NF96122
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF96122%27 HTTP/1.1" 200 None
2026-03-30 09:12:21 [auto1.it] INFO: Scrape type for NF96122: 0
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: LK74824
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: ZJ55913
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: GN63834
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: VL10175
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: YS71318
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS71318%27 HTTP/1.1" 200 None
2026-03-30 09:12:21 [auto1.it] INFO: Scrape type for YS71318: 0
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: CJ66066
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: UR23669
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR23669%27 HTTP/1.1" 200 None
2026-03-30 09:12:21 [auto1.it] INFO: Scrape type for UR23669: 0
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: DN72005
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN72005%27 HTTP/1.1" 200 None
2026-03-30 09:12:21 [auto1.it] INFO: Scrape type for DN72005: 0
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: AP13803
2026-03-30 09:12:21 [auto1.it] INFO: Found listing with ID: FJ79920
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ79920%27 HTTP/1.1" 200 None
2026-03-30 09:12:21 [auto1.it] INFO: Scrape type for FJ79920: 2
2026-03-30 09:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7983567d-018f-521d-b674-223c4a8b1252 with identifier: FJ79920
2026-03-30 09:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7983567d-018f-521d-b674-223c4a8b1252 with scrape type 2
2026-03-30 09:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7983567d-018f-521d-b674-223c4a8b1252 with scrape type 2
2026-03-30 09:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7983567d-018f-521d-b674-223c4a8b1252, identifier: FJ79920
2026-03-30 09:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7983567d-018f-521d-b674-223c4a8b1252 with identifier: FJ79920
2026-03-30 09:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7983567d-018f-521d-b674-223c4a8b1252 with identifier: FJ79920
2026-03-30 09:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7983567d-018f-521d-b674-223c4a8b1252 with identifier: FJ79920 to the API
2026-03-30 09:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:05:59Z',
 'fuel_type': 'petrol',
 'id': '7983567d-018f-521d-b674-223c4a8b1252',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ79920',
 'listing': 'auction',
 'make': 'Ssangyong',
 'model': 'Tivoli',
 'odometer': 162851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seller_name': None,
 'title': 'Ssangyong Tivoli 1.2 GDI Comfort 4x2',
 'transmission': 'manual',
 'trim': 'Comfort 4x2',
 'year': 2021}
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ79920%27 HTTP/1.1" 200 None
2026-03-30 09:12:22 [auto1.it] INFO: Saving data for FJ79920: {'auction_closing_time': 1774883159.0, 'created_time': 1774559396.652399, 'last_price_update_time': 1774861942.146612}
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ79920') HTTP/1.1" 204 0
2026-03-30 09:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: CF78450
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: DK34642
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK34642%27 HTTP/1.1" 200 None
2026-03-30 09:12:22 [auto1.it] INFO: Scrape type for DK34642: 0
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: BN52557
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN52557%27 HTTP/1.1" 200 None
2026-03-30 09:12:22 [auto1.it] INFO: Scrape type for BN52557: 0
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: CM00839
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM00839%27 HTTP/1.1" 200 None
2026-03-30 09:12:22 [auto1.it] INFO: Scrape type for CM00839: 0
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: TV74767
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV74767%27 HTTP/1.1" 200 None
2026-03-30 09:12:22 [auto1.it] INFO: Scrape type for TV74767: 0
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: KA06591
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: ZA06304
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: LJ91384
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ91384%27 HTTP/1.1" 200 None
2026-03-30 09:12:22 [auto1.it] INFO: Scrape type for LJ91384: 0
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: FL80694
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: XC85106
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC85106%27 HTTP/1.1" 200 None
2026-03-30 09:12:22 [auto1.it] INFO: Scrape type for XC85106: 0
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: YR53882
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: KT79218
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: FL90232
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL90232%27 HTTP/1.1" 200 None
2026-03-30 09:12:22 [auto1.it] INFO: Scrape type for FL90232: 0
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: CP26264
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP26264%27 HTTP/1.1" 200 None
2026-03-30 09:12:22 [auto1.it] INFO: Scrape type for CP26264: 0
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: TT97007
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT97007%27 HTTP/1.1" 200 None
2026-03-30 09:12:22 [auto1.it] INFO: Scrape type for TT97007: 0
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: GN74108
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN74108%27 HTTP/1.1" 200 None
2026-03-30 09:12:22 [auto1.it] INFO: Scrape type for GN74108: 0
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: DP39396
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: NC00198
2026-03-30 09:12:22 [auto1.it] INFO: Found listing with ID: HY77897
2026-03-30 09:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:23 [auto1.it] INFO: Channel: 24h | Page: 43 | totalHits: 3314 | hits on page: 40
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: HY77897
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: AG54549
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG54549%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for AG54549: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: UX44191
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX44191%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for UX44191: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: BW34835
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: BW24813
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW24813%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for BW24813: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: JF07503
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF07503%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for JF07503: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: UC47461
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: HS75117
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: NC89315
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: EM22547
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: AJ89778
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: FR80508
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR80508%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for FR80508: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: YP04797
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP04797%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for YP04797: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: DM32670
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: UN42756
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: PN03774
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: UN16063
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN16063%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for UN16063: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: SJ00829
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: MS47082
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: RM97748
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM97748%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for RM97748: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: NH03785
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: SM10455
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: CV79259
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: LH97251
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH97251%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for LH97251: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: JX68223
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: RJ82738
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ82738%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for RJ82738: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: KH49254
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH49254%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for KH49254: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: TT50547
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: JV05910
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: MA17223
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: PC08204
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: PV94920
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: ZW61080
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW61080%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for ZW61080: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: DK51991
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: GG10303
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: SY54924
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: GW48563
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: YE38738
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE38738%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for YE38738: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: RN44276
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN44276%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for RN44276: 0
2026-03-30 09:12:23 [auto1.it] INFO: Found listing with ID: JC71555
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC71555%27 HTTP/1.1" 200 None
2026-03-30 09:12:23 [auto1.it] INFO: Scrape type for JC71555: 2
2026-03-30 09:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 738ba76b-2113-5f98-b5b5-34cfb978fd42 with identifier: JC71555
2026-03-30 09:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 738ba76b-2113-5f98-b5b5-34cfb978fd42 with scrape type 2
2026-03-30 09:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 738ba76b-2113-5f98-b5b5-34cfb978fd42 with scrape type 2
2026-03-30 09:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 738ba76b-2113-5f98-b5b5-34cfb978fd42, identifier: JC71555
2026-03-30 09:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 738ba76b-2113-5f98-b5b5-34cfb978fd42 with identifier: JC71555
2026-03-30 09:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 738ba76b-2113-5f98-b5b5-34cfb978fd42 with identifier: JC71555
2026-03-30 09:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 738ba76b-2113-5f98-b5b5-34cfb978fd42 with identifier: JC71555 to the API
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:05:34Z',
 'fuel_type': 'diesel',
 'id': '738ba76b-2113-5f98-b5b5-34cfb978fd42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC71555',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 86629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-28',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 09:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC71555%27 HTTP/1.1" 200 None
2026-03-30 09:12:24 [auto1.it] INFO: Saving data for JC71555: {'auction_closing_time': 1774883134.0, 'created_time': 1774559440.255672, 'last_price_update_time': 1774861944.052846}
2026-03-30 09:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC71555') HTTP/1.1" 204 0
2026-03-30 09:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:25 [auto1.it] INFO: Channel: 24h | Page: 44 | totalHits: 3314 | hits on page: 40
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: AN07116
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: LH59018
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH59018%27 HTTP/1.1" 200 None
2026-03-30 09:12:25 [auto1.it] INFO: Scrape type for LH59018: 0
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: XG00486
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG00486%27 HTTP/1.1" 200 None
2026-03-30 09:12:25 [auto1.it] INFO: Scrape type for XG00486: 0
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: UK64691
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK64691%27 HTTP/1.1" 200 None
2026-03-30 09:12:25 [auto1.it] INFO: Scrape type for UK64691: 0
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: SG75657
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: SF23261
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: XW75946
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW75946%27 HTTP/1.1" 200 None
2026-03-30 09:12:25 [auto1.it] INFO: Scrape type for XW75946: 2
2026-03-30 09:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 338f21aa-dc2d-50d0-bc9c-15b1512fbefd with identifier: XW75946
2026-03-30 09:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 338f21aa-dc2d-50d0-bc9c-15b1512fbefd with scrape type 2
2026-03-30 09:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 338f21aa-dc2d-50d0-bc9c-15b1512fbefd with scrape type 2
2026-03-30 09:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 338f21aa-dc2d-50d0-bc9c-15b1512fbefd, identifier: XW75946
2026-03-30 09:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 338f21aa-dc2d-50d0-bc9c-15b1512fbefd with identifier: XW75946
2026-03-30 09:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 338f21aa-dc2d-50d0-bc9c-15b1512fbefd with identifier: XW75946
2026-03-30 09:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 338f21aa-dc2d-50d0-bc9c-15b1512fbefd with identifier: XW75946 to the API
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:37:24Z',
 'fuel_type': 'diesel',
 'id': '338f21aa-dc2d-50d0-bc9c-15b1512fbefd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW75946',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 112424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2012}
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW75946%27 HTTP/1.1" 200 None
2026-03-30 09:12:25 [auto1.it] INFO: Saving data for XW75946: {'auction_closing_time': 1774885044.0, 'created_time': 1774559526.892267, 'last_price_update_time': 1774861945.855386}
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XW75946') HTTP/1.1" 204 0
2026-03-30 09:12:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: SN49105
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN49105%27 HTTP/1.1" 200 None
2026-03-30 09:12:25 [auto1.it] INFO: Scrape type for SN49105: 0
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: SZ00349
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ00349%27 HTTP/1.1" 200 None
2026-03-30 09:12:25 [auto1.it] INFO: Scrape type for SZ00349: 0
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: UH39950
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH39950%27 HTTP/1.1" 200 None
2026-03-30 09:12:25 [auto1.it] INFO: Scrape type for UH39950: 0
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: RM88416
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM88416%27 HTTP/1.1" 200 None
2026-03-30 09:12:25 [auto1.it] INFO: Scrape type for RM88416: 0
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: EU38381
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU38381%27 HTTP/1.1" 200 None
2026-03-30 09:12:25 [auto1.it] INFO: Scrape type for EU38381: 0
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: MA83267
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: VY08024
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08024%27 HTTP/1.1" 200 None
2026-03-30 09:12:25 [auto1.it] INFO: Scrape type for VY08024: 0
2026-03-30 09:12:25 [auto1.it] INFO: Found listing with ID: AH42596
2026-03-30 09:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH42596%27 HTTP/1.1" 200 None
2026-03-30 09:12:26 [auto1.it] INFO: Scrape type for AH42596: 0
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: WE98269
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: SV89112
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV89112%27 HTTP/1.1" 200 None
2026-03-30 09:12:26 [auto1.it] INFO: Scrape type for SV89112: 0
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: ZX85690
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: JA21524
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: PA07928
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: LW29692
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW29692%27 HTTP/1.1" 200 None
2026-03-30 09:12:26 [auto1.it] INFO: Scrape type for LW29692: 0
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: RF58149
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: LY31332
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: KP29994
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: BJ69368
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ69368%27 HTTP/1.1" 200 None
2026-03-30 09:12:26 [auto1.it] INFO: Scrape type for BJ69368: 0
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: XF08656
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: WY54071
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: BD54797
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: CD59978
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: TA36833
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA36833%27 HTTP/1.1" 200 None
2026-03-30 09:12:26 [auto1.it] INFO: Scrape type for TA36833: 0
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: LX42454
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: ZT44032
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT44032%27 HTTP/1.1" 200 None
2026-03-30 09:12:26 [auto1.it] INFO: Scrape type for ZT44032: 0
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: TD38619
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD38619%27 HTTP/1.1" 200 None
2026-03-30 09:12:26 [auto1.it] INFO: Scrape type for TD38619: 0
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: GT16147
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT16147%27 HTTP/1.1" 200 None
2026-03-30 09:12:26 [auto1.it] INFO: Scrape type for GT16147: 0
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: LN05453
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: VA41104
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: ES59878
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: ZT67877
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT67877%27 HTTP/1.1" 200 None
2026-03-30 09:12:26 [auto1.it] INFO: Scrape type for ZT67877: 0
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: DJ48929
2026-03-30 09:12:26 [auto1.it] INFO: Found listing with ID: DV09922
2026-03-30 09:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:27 [auto1.it] INFO: Channel: 24h | Page: 45 | totalHits: 3314 | hits on page: 40
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: UW92889
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: NJ63404
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ63404%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for NJ63404: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: HV87754
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV87754%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for HV87754: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: TJ75665
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: TV86323
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV86323%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for TV86323: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: DM40972
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: TH27811
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH27811%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for TH27811: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: RL48638
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL48638%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for RL48638: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: TC65145
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC65145%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for TC65145: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: MB12953
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB12953%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for MB12953: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: YB75201
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: JR93194
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: ZM66429
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM66429%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for ZM66429: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: DC70843
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: ZW84587
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: WU80477
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU80477%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for WU80477: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: NF87616
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF87616%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for NF87616: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: AL30811
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL30811%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for AL30811: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: UT43750
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT43750%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for UT43750: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: AF97148
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF97148%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for AF97148: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: ZU39445
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU39445%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for ZU39445: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: KA22424
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: AM53032
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM53032%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for AM53032: 2
2026-03-30 09:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65545b75-bbba-5f0d-954c-60ca3197ac80 with identifier: AM53032
2026-03-30 09:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65545b75-bbba-5f0d-954c-60ca3197ac80 with scrape type 2
2026-03-30 09:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65545b75-bbba-5f0d-954c-60ca3197ac80 with scrape type 2
2026-03-30 09:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 65545b75-bbba-5f0d-954c-60ca3197ac80, identifier: AM53032
2026-03-30 09:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 65545b75-bbba-5f0d-954c-60ca3197ac80 with identifier: AM53032
2026-03-30 09:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 65545b75-bbba-5f0d-954c-60ca3197ac80 with identifier: AM53032
2026-03-30 09:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 65545b75-bbba-5f0d-954c-60ca3197ac80 with identifier: AM53032 to the API
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:35Z',
 'fuel_type': 'petrol',
 'id': '65545b75-bbba-5f0d-954c-60ca3197ac80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM53032',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 63075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-28',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid XLine 2WD',
 'transmission': 'automatic',
 'trim': 'XLine 2WD',
 'year': 2021}
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM53032%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Saving data for AM53032: {'auction_closing_time': 1774886075.0, 'created_time': 1774094853.516172, 'last_price_update_time': 1774861947.845451}
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AM53032') HTTP/1.1" 204 0
2026-03-30 09:12:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: ZU37783
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: GC28590
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC28590%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for GC28590: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: XF95831
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: WW13816
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: CR75802
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR75802%27 HTTP/1.1" 200 None
2026-03-30 09:12:27 [auto1.it] INFO: Scrape type for CR75802: 0
2026-03-30 09:12:27 [auto1.it] INFO: Found listing with ID: FN78187
2026-03-30 09:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN78187%27 HTTP/1.1" 200 None
2026-03-30 09:12:28 [auto1.it] INFO: Scrape type for FN78187: 0
2026-03-30 09:12:28 [auto1.it] INFO: Found listing with ID: ZV13161
2026-03-30 09:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV13161%27 HTTP/1.1" 200 None
2026-03-30 09:12:28 [auto1.it] INFO: Scrape type for ZV13161: 0
2026-03-30 09:12:28 [auto1.it] INFO: Found listing with ID: GY86444
2026-03-30 09:12:28 [auto1.it] INFO: Found listing with ID: SE74727
2026-03-30 09:12:28 [auto1.it] INFO: Found listing with ID: DC79490
2026-03-30 09:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC79490%27 HTTP/1.1" 200 None
2026-03-30 09:12:28 [auto1.it] INFO: Scrape type for DC79490: 0
2026-03-30 09:12:28 [auto1.it] INFO: Found listing with ID: HJ71706
2026-03-30 09:12:28 [auto1.it] INFO: Found listing with ID: ZW42216
2026-03-30 09:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW42216%27 HTTP/1.1" 200 None
2026-03-30 09:12:28 [auto1.it] INFO: Scrape type for ZW42216: 0
2026-03-30 09:12:28 [auto1.it] INFO: Found listing with ID: WP65731
2026-03-30 09:12:28 [auto1.it] INFO: Found listing with ID: FG66384
2026-03-30 09:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG66384%27 HTTP/1.1" 200 None
2026-03-30 09:12:28 [auto1.it] INFO: Scrape type for FG66384: 0
2026-03-30 09:12:28 [auto1.it] INFO: Found listing with ID: MC91027
2026-03-30 09:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC91027%27 HTTP/1.1" 200 None
2026-03-30 09:12:28 [auto1.it] INFO: Scrape type for MC91027: 0
2026-03-30 09:12:28 [auto1.it] INFO: Found listing with ID: CN54432
2026-03-30 09:12:28 [auto1.it] INFO: Found listing with ID: NL99769
2026-03-30 09:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:29 [auto1.it] INFO: Channel: 24h | Page: 46 | totalHits: 3314 | hits on page: 40
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: MZ97051
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ97051%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for MZ97051: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: DW35808
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW35808%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for DW35808: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: DW91233
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: BF95758
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF95758%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for BF95758: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: FT00845
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: RG91775
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: ZF37954
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: RG06778
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG06778%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for RG06778: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: PS40086
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS40086%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for PS40086: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: LB35454
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB35454%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for LB35454: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: XH07717
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH07717%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for XH07717: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: FC72088
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: XY56734
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: HU04780
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU04780%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for HU04780: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: RF41966
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: UH63202
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: WK88793
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: VY30881
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: JV49964
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV49964%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for JV49964: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: FG41149
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG41149%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for FG41149: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: HE58096
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE58096%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for HE58096: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: HY50336
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: YM68683
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM68683%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for YM68683: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: AK04319
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: BR57787
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: EW75020
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW75020%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for EW75020: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: JU21728
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU21728%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for JU21728: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: BD43330
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD43330%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for BD43330: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: SS18980
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: PA42280
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA42280%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for PA42280: 2
2026-03-30 09:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94cef932-4fbd-5b7e-91c0-70f943cdecbb with identifier: PA42280
2026-03-30 09:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94cef932-4fbd-5b7e-91c0-70f943cdecbb with scrape type 2
2026-03-30 09:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94cef932-4fbd-5b7e-91c0-70f943cdecbb with scrape type 2
2026-03-30 09:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 94cef932-4fbd-5b7e-91c0-70f943cdecbb, identifier: PA42280
2026-03-30 09:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 94cef932-4fbd-5b7e-91c0-70f943cdecbb with identifier: PA42280
2026-03-30 09:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 94cef932-4fbd-5b7e-91c0-70f943cdecbb with identifier: PA42280
2026-03-30 09:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 94cef932-4fbd-5b7e-91c0-70f943cdecbb with identifier: PA42280 to the API
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:17Z',
 'fuel_type': 'petrol',
 'id': '94cef932-4fbd-5b7e-91c0-70f943cdecbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA42280',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 157168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-28',
 'seller_name': None,
 'title': 'Nissan Micra 1.6 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2008}
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA42280%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Saving data for PA42280: {'auction_closing_time': 1774884617.0, 'created_time': 1774559410.862662, 'last_price_update_time': 1774861949.77617}
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PA42280') HTTP/1.1" 204 0
2026-03-30 09:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: WP88184
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP88184%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for WP88184: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: FT22704
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: YS49191
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: LT75746
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: WS24501
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: CS16004
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS16004%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for CS16004: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: LY57551
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY57551%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for LY57551: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: HA44632
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA44632%27 HTTP/1.1" 200 None
2026-03-30 09:12:29 [auto1.it] INFO: Scrape type for HA44632: 0
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: JS42398
2026-03-30 09:12:29 [auto1.it] INFO: Found listing with ID: EN82101
2026-03-30 09:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:31 [auto1.it] INFO: Channel: 24h | Page: 47 | totalHits: 3314 | hits on page: 40
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: FU42856
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: LW40364
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW40364%27 HTTP/1.1" 200 None
2026-03-30 09:12:31 [auto1.it] INFO: Scrape type for LW40364: 0
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: HU53243
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: RB41794
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: CP99007
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: NF26556
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF26556%27 HTTP/1.1" 200 None
2026-03-30 09:12:31 [auto1.it] INFO: Scrape type for NF26556: 0
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: NZ37386
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: LG11183
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: LC07756
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: RU03062
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: SN43721
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: SA71650
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: SH22107
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH22107%27 HTTP/1.1" 200 None
2026-03-30 09:12:31 [auto1.it] INFO: Scrape type for SH22107: 0
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: DB18786
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: VE23835
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE23835%27 HTTP/1.1" 200 None
2026-03-30 09:12:31 [auto1.it] INFO: Scrape type for VE23835: 0
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: ZR59714
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: VC26054
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: GV78973
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: US69373
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: RZ15516
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: UZ55357
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: EJ70164
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: DW16027
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW16027%27 HTTP/1.1" 200 None
2026-03-30 09:12:31 [auto1.it] INFO: Scrape type for DW16027: 0
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: EZ15489
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: XC90090
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC90090%27 HTTP/1.1" 200 None
2026-03-30 09:12:31 [auto1.it] INFO: Scrape type for XC90090: 0
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: PZ08956
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ08956%27 HTTP/1.1" 200 None
2026-03-30 09:12:31 [auto1.it] INFO: Scrape type for PZ08956: 0
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: LB78915
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: BV29552
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV29552%27 HTTP/1.1" 200 None
2026-03-30 09:12:31 [auto1.it] INFO: Scrape type for BV29552: 0
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: TK94629
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK94629%27 HTTP/1.1" 200 None
2026-03-30 09:12:31 [auto1.it] INFO: Scrape type for TK94629: 0
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: XT45099
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: DX23883
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: FM13591
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: VS11522
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS11522%27 HTTP/1.1" 200 None
2026-03-30 09:12:31 [auto1.it] INFO: Scrape type for VS11522: 0
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: YA27066
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: YC82026
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC82026%27 HTTP/1.1" 200 None
2026-03-30 09:12:31 [auto1.it] INFO: Scrape type for YC82026: 0
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: AM02692
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: BF81880
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: MU47199
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: SL34558
2026-03-30 09:12:31 [auto1.it] INFO: Found listing with ID: RJ45303
2026-03-30 09:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:32 [auto1.it] INFO: Channel: 24h | Page: 48 | totalHits: 3314 | hits on page: 40
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: NP01679
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: ZJ24732
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: FY53013
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY53013%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for FY53013: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: LA76603
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA76603%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for LA76603: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: AY40178
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY40178%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for AY40178: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: UK76860
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK76860%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for UK76860: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: RD96225
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: ES67961
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: WH06276
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH06276%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for WH06276: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: JY18899
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: AH91466
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: CH37521
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH37521%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for CH37521: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: UW72001
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW72001%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for UW72001: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: SN82896
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: UM78803
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM78803%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for UM78803: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: KR43222
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: LV68988
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: BR67394
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR67394%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for BR67394: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: CY31858
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY31858%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for CY31858: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: RD78006
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: CD01213
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD01213%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for CD01213: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: SN26450
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN26450%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for SN26450: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: MT71865
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: CP76510
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP76510%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for CP76510: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: YX83263
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: PZ52577
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ52577%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for PZ52577: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: VS54724
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: KH25019
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: PN56075
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: HZ92978
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: EC20535
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: VX84045
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: YJ87795
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: JT68367
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: XZ26785
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: YZ06369
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: ZS94509
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: CV42265
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV42265%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for CV42265: 0
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: SM34278
2026-03-30 09:12:32 [auto1.it] INFO: Found listing with ID: RG49415
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG49415%27 HTTP/1.1" 200 None
2026-03-30 09:12:32 [auto1.it] INFO: Scrape type for RG49415: 0
2026-03-30 09:12:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:40 [auto1.it] INFO: Channel: 24h | Page: 49 | totalHits: 3314 | hits on page: 40
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: EB44721
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB44721%27 HTTP/1.1" 200 None
2026-03-30 09:12:40 [auto1.it] INFO: Scrape type for EB44721: 0
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: LM72883
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM72883%27 HTTP/1.1" 200 None
2026-03-30 09:12:40 [auto1.it] INFO: Scrape type for LM72883: 0
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: JC85025
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: FC91970
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC91970%27 HTTP/1.1" 200 None
2026-03-30 09:12:40 [auto1.it] INFO: Scrape type for FC91970: 0
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: PR30387
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR30387%27 HTTP/1.1" 200 None
2026-03-30 09:12:40 [auto1.it] INFO: Scrape type for PR30387: 0
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: NN68396
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: BS72965
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: BE28605
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: JF19899
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: TG15136
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG15136%27 HTTP/1.1" 200 None
2026-03-30 09:12:40 [auto1.it] INFO: Scrape type for TG15136: 0
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: YG71564
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: DT34666
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: TK41328
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: NP33035
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP33035%27 HTTP/1.1" 200 None
2026-03-30 09:12:40 [auto1.it] INFO: Scrape type for NP33035: 0
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: LH23447
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: NT98508
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT98508%27 HTTP/1.1" 200 None
2026-03-30 09:12:40 [auto1.it] INFO: Scrape type for NT98508: 0
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: BW44627
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: SN54717
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: XE50216
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: RA17642
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: DP78893
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP78893%27 HTTP/1.1" 200 None
2026-03-30 09:12:40 [auto1.it] INFO: Scrape type for DP78893: 0
2026-03-30 09:12:40 [auto1.it] INFO: Found listing with ID: ZR71790
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR71790%27 HTTP/1.1" 200 None
2026-03-30 09:12:40 [auto1.it] INFO: Scrape type for ZR71790: 2
2026-03-30 09:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b7b9e6a-1717-5c14-8263-aa7bd474503d with identifier: ZR71790
2026-03-30 09:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b7b9e6a-1717-5c14-8263-aa7bd474503d with scrape type 2
2026-03-30 09:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b7b9e6a-1717-5c14-8263-aa7bd474503d with scrape type 2
2026-03-30 09:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b7b9e6a-1717-5c14-8263-aa7bd474503d, identifier: ZR71790
2026-03-30 09:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b7b9e6a-1717-5c14-8263-aa7bd474503d with identifier: ZR71790
2026-03-30 09:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b7b9e6a-1717-5c14-8263-aa7bd474503d with identifier: ZR71790
2026-03-30 09:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b7b9e6a-1717-5c14-8263-aa7bd474503d with identifier: ZR71790 to the API
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:10:28Z',
 'fuel_type': 'diesel',
 'id': '3b7b9e6a-1717-5c14-8263-aa7bd474503d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR71790',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 350607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-23',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR71790%27 HTTP/1.1" 200 None
2026-03-30 09:12:41 [auto1.it] INFO: Saving data for ZR71790: {'auction_closing_time': 1774883428.0, 'created_time': 1774559388.094675, 'last_price_update_time': 1774861961.274095}
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR71790') HTTP/1.1" 204 0
2026-03-30 09:12:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: VS39586
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS39586%27 HTTP/1.1" 200 None
2026-03-30 09:12:41 [auto1.it] INFO: Scrape type for VS39586: 0
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: WZ23561
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: HU57000
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU57000%27 HTTP/1.1" 200 None
2026-03-30 09:12:41 [auto1.it] INFO: Scrape type for HU57000: 0
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: KX90230
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: MZ03364
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: YH14903
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH14903%27 HTTP/1.1" 200 None
2026-03-30 09:12:41 [auto1.it] INFO: Scrape type for YH14903: 0
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: TG59717
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG59717%27 HTTP/1.1" 200 None
2026-03-30 09:12:41 [auto1.it] INFO: Scrape type for TG59717: 0
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: JP72281
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP72281%27 HTTP/1.1" 200 None
2026-03-30 09:12:41 [auto1.it] INFO: Scrape type for JP72281: 0
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: DW12777
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: RB40748
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: UU51056
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: RY04213
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY04213%27 HTTP/1.1" 200 None
2026-03-30 09:12:41 [auto1.it] INFO: Scrape type for RY04213: 0
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: CW11036
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: RM58290
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: WV91656
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV91656%27 HTTP/1.1" 200 None
2026-03-30 09:12:41 [auto1.it] INFO: Scrape type for WV91656: 0
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: RF27989
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF27989%27 HTTP/1.1" 200 None
2026-03-30 09:12:41 [auto1.it] INFO: Scrape type for RF27989: 0
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: EP92787
2026-03-30 09:12:41 [auto1.it] INFO: Found listing with ID: HZ65981
2026-03-30 09:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:42 [auto1.it] INFO: Channel: 24h | Page: 50 | totalHits: 3315 | hits on page: 40
2026-03-30 09:12:42 [auto1.it] INFO: Found listing with ID: HZ65981
2026-03-30 09:12:42 [auto1.it] INFO: Found listing with ID: VV97216
2026-03-30 09:12:42 [auto1.it] INFO: Found listing with ID: PD07113
2026-03-30 09:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD07113%27 HTTP/1.1" 200 None
2026-03-30 09:12:42 [auto1.it] INFO: Scrape type for PD07113: 0
2026-03-30 09:12:42 [auto1.it] INFO: Found listing with ID: WG94514
2026-03-30 09:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG94514%27 HTTP/1.1" 200 None
2026-03-30 09:12:42 [auto1.it] INFO: Scrape type for WG94514: 0
2026-03-30 09:12:42 [auto1.it] INFO: Found listing with ID: EP88995
2026-03-30 09:12:42 [auto1.it] INFO: Found listing with ID: KT34727
2026-03-30 09:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT34727%27 HTTP/1.1" 200 None
2026-03-30 09:12:42 [auto1.it] INFO: Scrape type for KT34727: 0
2026-03-30 09:12:42 [auto1.it] INFO: Found listing with ID: LG27793
2026-03-30 09:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG27793%27 HTTP/1.1" 200 None
2026-03-30 09:12:42 [auto1.it] INFO: Scrape type for LG27793: 0
2026-03-30 09:12:42 [auto1.it] INFO: Found listing with ID: ZR58855
2026-03-30 09:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR58855%27 HTTP/1.1" 200 None
2026-03-30 09:12:42 [auto1.it] INFO: Scrape type for ZR58855: 2
2026-03-30 09:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae526588-a1fd-58b7-8150-7c0cb74ce9b5 with identifier: ZR58855
2026-03-30 09:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae526588-a1fd-58b7-8150-7c0cb74ce9b5 with scrape type 2
2026-03-30 09:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae526588-a1fd-58b7-8150-7c0cb74ce9b5 with scrape type 2
2026-03-30 09:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae526588-a1fd-58b7-8150-7c0cb74ce9b5, identifier: ZR58855
2026-03-30 09:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae526588-a1fd-58b7-8150-7c0cb74ce9b5 with identifier: ZR58855
2026-03-30 09:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae526588-a1fd-58b7-8150-7c0cb74ce9b5 with identifier: ZR58855
2026-03-30 09:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae526588-a1fd-58b7-8150-7c0cb74ce9b5 with identifier: ZR58855 to the API
2026-03-30 09:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 76,
 'expiration_date': '2026-03-30T15:03:14Z',
 'fuel_type': 'petrol',
 'id': 'ae526588-a1fd-58b7-8150-7c0cb74ce9b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR58855',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 171931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-19',
 'seller_name': None,
 'title': 'Renault Clio 0.9 TCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2019}
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR58855%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Saving data for ZR58855: {'auction_closing_time': 1774882994.0, 'created_time': 1774559564.451637, 'last_price_update_time': 1774861963.149899}
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZR58855') HTTP/1.1" 204 0
2026-03-30 09:12:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: HB10468
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB10468%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for HB10468: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: BA64945
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: WT06044
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: GM73700
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: VV94396
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV94396%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for VV94396: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: ER90508
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: UN52705
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN52705%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for UN52705: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: FG85862
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG85862%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for FG85862: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: RN28631
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: NE13837
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: JJ76443
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ76443%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for JJ76443: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: SR58570
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR58570%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for SR58570: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: AG93268
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG93268%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for AG93268: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: YM91095
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM91095%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for YM91095: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: SW20348
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: KH50025
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: YD48620
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: CH31271
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: NR94524
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: ME64112
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME64112%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for ME64112: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: LC62662
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC62662%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for LC62662: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: NG42330
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: LY59830
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY59830%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for LY59830: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: GZ29519
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ29519%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for GZ29519: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: KW57065
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW57065%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for KW57065: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: XU45966
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: XP38873
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: UA81726
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA81726%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for UA81726: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: LP45822
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP45822%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for LP45822: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: ZZ85760
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ85760%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for ZZ85760: 0
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: VY12867
2026-03-30 09:12:43 [auto1.it] INFO: Found listing with ID: NR23984
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR23984%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Scrape type for NR23984: 2
2026-03-30 09:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd075fc0-1d87-579f-a75c-b0d55da23441 with identifier: NR23984
2026-03-30 09:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd075fc0-1d87-579f-a75c-b0d55da23441 with scrape type 2
2026-03-30 09:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd075fc0-1d87-579f-a75c-b0d55da23441 with scrape type 2
2026-03-30 09:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd075fc0-1d87-579f-a75c-b0d55da23441, identifier: NR23984
2026-03-30 09:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd075fc0-1d87-579f-a75c-b0d55da23441 with identifier: NR23984
2026-03-30 09:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd075fc0-1d87-579f-a75c-b0d55da23441 with identifier: NR23984
2026-03-30 09:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd075fc0-1d87-579f-a75c-b0d55da23441 with identifier: NR23984 to the API
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:04:55Z',
 'fuel_type': 'diesel',
 'id': 'dd075fc0-1d87-579f-a75c-b0d55da23441',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR23984',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 228527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'Jeep Compass 1.6 M-Jet Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2019}
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR23984%27 HTTP/1.1" 200 None
2026-03-30 09:12:43 [auto1.it] INFO: Saving data for NR23984: {'auction_closing_time': 1774883095.0, 'created_time': 1774559449.059878, 'last_price_update_time': 1774861963.952383}
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR23984') HTTP/1.1" 204 0
2026-03-30 09:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:45 [auto1.it] INFO: Channel: 24h | Page: 51 | totalHits: 3315 | hits on page: 40
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: ET23172
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET23172%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for ET23172: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: TC50511
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: FN23706
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: FK20941
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: VC63991
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: ZK25944
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25944%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for ZK25944: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: VP99832
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP99832%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for VP99832: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: MU83341
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: EC55479
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: JE16682
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE16682%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for JE16682: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: VP75887
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP75887%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for VP75887: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: YH05705
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: DN97608
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: AF46529
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF46529%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for AF46529: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: BJ63933
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: LW86872
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW86872%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for LW86872: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: PA70519
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA70519%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for PA70519: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: UT42979
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT42979%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for UT42979: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: RS56443
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: LN57194
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN57194%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for LN57194: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: HY22945
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY22945%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for HY22945: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: CC46702
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: PL71131
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: JG85699
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG85699%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for JG85699: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: AK60352
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK60352%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for AK60352: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: YA87774
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA87774%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for YA87774: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: PN28374
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN28374%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for PN28374: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: VA22015
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA22015%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for VA22015: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: MR41650
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: AN53744
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: KL25988
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: NL15395
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL15395%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for NL15395: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: ZW56281
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW56281%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for ZW56281: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: KK35105
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: GZ99467
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ99467%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for GZ99467: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: ER51817
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: GB19602
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: SR85753
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR85753%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for SR85753: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: WD12881
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD12881%27 HTTP/1.1" 200 None
2026-03-30 09:12:45 [auto1.it] INFO: Scrape type for WD12881: 0
2026-03-30 09:12:45 [auto1.it] INFO: Found listing with ID: NP37024
2026-03-30 09:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:46 [auto1.it] INFO: Channel: 24h | Page: 52 | totalHits: 3315 | hits on page: 40
2026-03-30 09:12:46 [auto1.it] INFO: Found listing with ID: WB02861
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB02861%27 HTTP/1.1" 200 None
2026-03-30 09:12:46 [auto1.it] INFO: Scrape type for WB02861: 0
2026-03-30 09:12:46 [auto1.it] INFO: Found listing with ID: YG18213
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG18213%27 HTTP/1.1" 200 None
2026-03-30 09:12:46 [auto1.it] INFO: Scrape type for YG18213: 0
2026-03-30 09:12:46 [auto1.it] INFO: Found listing with ID: NA90799
2026-03-30 09:12:46 [auto1.it] INFO: Found listing with ID: JB43722
2026-03-30 09:12:46 [auto1.it] INFO: Found listing with ID: SY65620
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY65620%27 HTTP/1.1" 200 None
2026-03-30 09:12:46 [auto1.it] INFO: Scrape type for SY65620: 0
2026-03-30 09:12:46 [auto1.it] INFO: Found listing with ID: VC37401
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC37401%27 HTTP/1.1" 200 None
2026-03-30 09:12:46 [auto1.it] INFO: Scrape type for VC37401: 0
2026-03-30 09:12:46 [auto1.it] INFO: Found listing with ID: JB22661
2026-03-30 09:12:46 [auto1.it] INFO: Found listing with ID: CH30071
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH30071%27 HTTP/1.1" 200 None
2026-03-30 09:12:46 [auto1.it] INFO: Scrape type for CH30071: 0
2026-03-30 09:12:46 [auto1.it] INFO: Found listing with ID: PS88419
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS88419%27 HTTP/1.1" 200 None
2026-03-30 09:12:46 [auto1.it] INFO: Scrape type for PS88419: 2
2026-03-30 09:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b8e4cdf-6947-5fb1-b05b-6114e59048d1 with identifier: PS88419
2026-03-30 09:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b8e4cdf-6947-5fb1-b05b-6114e59048d1 with scrape type 2
2026-03-30 09:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b8e4cdf-6947-5fb1-b05b-6114e59048d1 with scrape type 2
2026-03-30 09:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b8e4cdf-6947-5fb1-b05b-6114e59048d1, identifier: PS88419
2026-03-30 09:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b8e4cdf-6947-5fb1-b05b-6114e59048d1 with identifier: PS88419
2026-03-30 09:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b8e4cdf-6947-5fb1-b05b-6114e59048d1 with identifier: PS88419
2026-03-30 09:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b8e4cdf-6947-5fb1-b05b-6114e59048d1 with identifier: PS88419 to the API
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:23:29Z',
 'fuel_type': 'diesel',
 'id': '7b8e4cdf-6947-5fb1-b05b-6114e59048d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS88419',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 130364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS88419%27 HTTP/1.1" 200 None
2026-03-30 09:12:46 [auto1.it] INFO: Saving data for PS88419: {'auction_closing_time': 1774884209.0, 'created_time': 1774559490.845022, 'last_price_update_time': 1774861966.928651}
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PS88419') HTTP/1.1" 204 0
2026-03-30 09:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: SG58934
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: WP29588
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: EH79430
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: ZY20684
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: ZE54964
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE54964%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for ZE54964: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: SH99694
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH99694%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for SH99694: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: YD47870
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD47870%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for YD47870: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: HP26181
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: CA11225
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA11225%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for CA11225: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: GZ15334
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ15334%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for GZ15334: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: NR19227
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR19227%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for NR19227: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: PE03343
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: MG44195
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: CD48597
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD48597%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for CD48597: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: ZL42866
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL42866%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for ZL42866: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: TD16332
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: XX72612
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: FZ15341
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ15341%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for FZ15341: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: FB65897
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB65897%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for FB65897: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: UJ60071
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: LU21739
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: JD30560
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD30560%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for JD30560: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: WM75200
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: TW16481
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW16481%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for TW16481: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: HE90318
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: JZ67202
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: XJ00543
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: HG18459
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG18459%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for HG18459: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: RS41050
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS41050%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for RS41050: 0
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: YX10047
2026-03-30 09:12:47 [auto1.it] INFO: Found listing with ID: KD38461
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD38461%27 HTTP/1.1" 200 None
2026-03-30 09:12:47 [auto1.it] INFO: Scrape type for KD38461: 0
2026-03-30 09:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:48 [auto1.it] INFO: Channel: 24h | Page: 53 | totalHits: 3315 | hits on page: 40
2026-03-30 09:12:48 [auto1.it] INFO: Found listing with ID: HS22192
2026-03-30 09:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS22192%27 HTTP/1.1" 200 None
2026-03-30 09:12:48 [auto1.it] INFO: Scrape type for HS22192: 2
2026-03-30 09:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d65abb3-44c1-556a-9fd1-5a6349c77cd3 with identifier: HS22192
2026-03-30 09:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d65abb3-44c1-556a-9fd1-5a6349c77cd3 with scrape type 2
2026-03-30 09:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d65abb3-44c1-556a-9fd1-5a6349c77cd3 with scrape type 2
2026-03-30 09:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7d65abb3-44c1-556a-9fd1-5a6349c77cd3, identifier: HS22192
2026-03-30 09:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7d65abb3-44c1-556a-9fd1-5a6349c77cd3 with identifier: HS22192
2026-03-30 09:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7d65abb3-44c1-556a-9fd1-5a6349c77cd3 with identifier: HS22192
2026-03-30 09:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7d65abb3-44c1-556a-9fd1-5a6349c77cd3 with identifier: HS22192 to the API
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:50:52Z',
 'fuel_type': 'diesel',
 'id': '7d65abb3-44c1-556a-9fd1-5a6349c77cd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS22192',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 43495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 CRDi Mild-Hybrid High Tech',
 'transmission': 'manual',
 'trim': 'High Tech',
 'year': 2022}
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS22192%27 HTTP/1.1" 200 None
2026-03-30 09:12:49 [auto1.it] INFO: Saving data for HS22192: {'auction_closing_time': 1774885852.0, 'created_time': 1774083961.989938, 'last_price_update_time': 1774861969.263084}
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HS22192') HTTP/1.1" 204 0
2026-03-30 09:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:49 [auto1.it] INFO: Found listing with ID: UA91591
2026-03-30 09:12:49 [auto1.it] INFO: Found listing with ID: VC28315
2026-03-30 09:12:49 [auto1.it] INFO: Found listing with ID: XC32215
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC32215%27 HTTP/1.1" 200 None
2026-03-30 09:12:49 [auto1.it] INFO: Scrape type for XC32215: 0
2026-03-30 09:12:49 [auto1.it] INFO: Found listing with ID: VJ93406
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ93406%27 HTTP/1.1" 200 None
2026-03-30 09:12:49 [auto1.it] INFO: Scrape type for VJ93406: 0
2026-03-30 09:12:49 [auto1.it] INFO: Found listing with ID: PE96276
2026-03-30 09:12:49 [auto1.it] INFO: Found listing with ID: HA39708
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA39708%27 HTTP/1.1" 200 None
2026-03-30 09:12:49 [auto1.it] INFO: Scrape type for HA39708: 0
2026-03-30 09:12:49 [auto1.it] INFO: Found listing with ID: SG53706
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG53706%27 HTTP/1.1" 200 None
2026-03-30 09:12:49 [auto1.it] INFO: Scrape type for SG53706: 0
2026-03-30 09:12:49 [auto1.it] INFO: Found listing with ID: CU47897
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU47897%27 HTTP/1.1" 200 None
2026-03-30 09:12:49 [auto1.it] INFO: Scrape type for CU47897: 0
2026-03-30 09:12:49 [auto1.it] INFO: Found listing with ID: RL61545
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL61545%27 HTTP/1.1" 200 None
2026-03-30 09:12:49 [auto1.it] INFO: Scrape type for RL61545: 0
2026-03-30 09:12:49 [auto1.it] INFO: Found listing with ID: XC82626
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC82626%27 HTTP/1.1" 200 None
2026-03-30 09:12:49 [auto1.it] INFO: Scrape type for XC82626: 0
2026-03-30 09:12:49 [auto1.it] INFO: Found listing with ID: SU56229
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU56229%27 HTTP/1.1" 200 None
2026-03-30 09:12:49 [auto1.it] INFO: Scrape type for SU56229: 2
2026-03-30 09:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90776619-8ddb-5e85-8642-191f414f73ac with identifier: SU56229
2026-03-30 09:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90776619-8ddb-5e85-8642-191f414f73ac with scrape type 2
2026-03-30 09:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90776619-8ddb-5e85-8642-191f414f73ac with scrape type 2
2026-03-30 09:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 90776619-8ddb-5e85-8642-191f414f73ac, identifier: SU56229
2026-03-30 09:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 90776619-8ddb-5e85-8642-191f414f73ac with identifier: SU56229
2026-03-30 09:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 90776619-8ddb-5e85-8642-191f414f73ac with identifier: SU56229
2026-03-30 09:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 90776619-8ddb-5e85-8642-191f414f73ac with identifier: SU56229 to the API
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:40:52Z',
 'fuel_type': 'petrol',
 'id': '90776619-8ddb-5e85-8642-191f414f73ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU56229',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 124952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2019}
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU56229%27 HTTP/1.1" 200 None
2026-03-30 09:12:49 [auto1.it] INFO: Saving data for SU56229: {'auction_closing_time': 1774885252.0, 'created_time': 1774559372.515539, 'last_price_update_time': 1774861969.903116}
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SU56229') HTTP/1.1" 204 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: PN01400
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN01400%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for PN01400: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: SS15336
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: YW98083
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW98083%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for YW98083: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: XA66823
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: MM82110
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM82110%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for MM82110: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: EG94847
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: YM64414
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM64414%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for YM64414: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: MD14180
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD14180%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for MD14180: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: KW88913
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW88913%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for KW88913: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: BX20882
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX20882%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for BX20882: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: RJ76809
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: YT99583
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT99583%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for YT99583: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: MS79311
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: WU32452
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU32452%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for WU32452: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: BL33415
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: ZJ46829
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: ZJ21397
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: JK56818
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: JD30640
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD30640%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for JD30640: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: MV49803
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: MZ03960
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: JL83365
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: UX28393
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: MU61390
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU61390%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for MU61390: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: HY18936
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: VY08559
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08559%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for VY08559: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: PV59173
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV59173%27 HTTP/1.1" 200 None
2026-03-30 09:12:50 [auto1.it] INFO: Scrape type for PV59173: 0
2026-03-30 09:12:50 [auto1.it] INFO: Found listing with ID: YU18545
2026-03-30 09:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:51 [auto1.it] INFO: Channel: 24h | Page: 54 | totalHits: 3315 | hits on page: 40
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: UR28230
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR28230%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for UR28230: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: XJ39462
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ39462%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for XJ39462: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: FN50437
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: DK87302
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK87302%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for DK87302: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: WD34729
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD34729%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for WD34729: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: HK70439
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: EP08968
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: EY33952
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: LB07538
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: KG02437
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG02437%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for KG02437: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: PY21369
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY21369%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for PY21369: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: BE36594
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: YH78085
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: LZ72377
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ72377%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for LZ72377: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: VM78443
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM78443%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for VM78443: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: MS56995
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS56995%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for MS56995: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: CS68621
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: XY41121
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY41121%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for XY41121: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: GX81106
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX81106%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for GX81106: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: HG73673
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG73673%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for HG73673: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: GF63115
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: HK94664
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: PA21374
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA21374%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for PA21374: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: NW58325
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: GT90583
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: DX18897
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX18897%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for DX18897: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: FC73004
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC73004%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for FC73004: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: ZX72389
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: EZ27389
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ27389%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for EZ27389: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: LS28867
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS28867%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for LS28867: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: EZ66710
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ66710%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for EZ66710: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: DP87516
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP87516%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for DP87516: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: WP21128
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: DV60834
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV60834%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for DV60834: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: PS94410
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: TG24306
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG24306%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for TG24306: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: TK35909
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: PC99456
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC99456%27 HTTP/1.1" 200 None
2026-03-30 09:12:51 [auto1.it] INFO: Scrape type for PC99456: 0
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: CT52714
2026-03-30 09:12:51 [auto1.it] INFO: Found listing with ID: JU67462
2026-03-30 09:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:52 [auto1.it] INFO: Channel: 24h | Page: 55 | totalHits: 3315 | hits on page: 40
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: CG84087
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: VE26782
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE26782%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for VE26782: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: JU78402
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU78402%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for JU78402: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: AE85133
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: UX29999
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: PK65337
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: CZ68446
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ68446%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for CZ68446: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: UB12324
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: UU69652
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU69652%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for UU69652: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: MT44233
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: WH17825
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH17825%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for WH17825: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: UR14764
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR14764%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for UR14764: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: HR66434
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR66434%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for HR66434: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: GF05972
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF05972%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for GF05972: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: YK06699
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK06699%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for YK06699: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: JR97776
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR97776%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for JR97776: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: BE98404
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: KF31033
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF31033%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for KF31033: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: FF48098
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: YW01927
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: FT76605
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT76605%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for FT76605: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: JY35916
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY35916%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for JY35916: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: GD10861
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD10861%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for GD10861: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: JA46265
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA46265%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for JA46265: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: ET57280
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET57280%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for ET57280: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: BM81624
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: WF71586
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: DN99534
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN99534%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for DN99534: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: XJ23148
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ23148%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for XJ23148: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: YU33914
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU33914%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for YU33914: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: PT53216
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: GC53002
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC53002%27 HTTP/1.1" 200 None
2026-03-30 09:12:52 [auto1.it] INFO: Scrape type for GC53002: 0
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: GJ43112
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: AZ52753
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: CT25036
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: FZ67880
2026-03-30 09:12:52 [auto1.it] INFO: Found listing with ID: VY96828
2026-03-30 09:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY96828%27 HTTP/1.1" 200 None
2026-03-30 09:12:53 [auto1.it] INFO: Scrape type for VY96828: 0
2026-03-30 09:12:53 [auto1.it] INFO: Found listing with ID: GA58857
2026-03-30 09:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA58857%27 HTTP/1.1" 200 None
2026-03-30 09:12:53 [auto1.it] INFO: Scrape type for GA58857: 0
2026-03-30 09:12:53 [auto1.it] INFO: Found listing with ID: AN61279
2026-03-30 09:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN61279%27 HTTP/1.1" 200 None
2026-03-30 09:12:53 [auto1.it] INFO: Scrape type for AN61279: 0
2026-03-30 09:12:53 [auto1.it] INFO: Found listing with ID: GX83807
2026-03-30 09:12:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:54 [auto1.it] INFO: Channel: 24h | Page: 56 | totalHits: 3315 | hits on page: 40
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: FL80724
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL80724%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for FL80724: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: ZT64017
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: AB97936
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: YL77107
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: UW31013
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: SN78206
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN78206%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for SN78206: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: AN14799
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN14799%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for AN14799: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: UL06285
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: HG91847
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG91847%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for HG91847: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: NW69655
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW69655%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for NW69655: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: ER04044
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER04044%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for ER04044: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: BJ95013
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: AH48855
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: EX06757
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: WW83170
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: HR62667
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR62667%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for HR62667: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: BJ71456
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: TN35413
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN35413%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for TN35413: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: ZG86392
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG86392%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for ZG86392: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: YB89619
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: PH76883
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH76883%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for PH76883: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: MJ42614
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ42614%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for MJ42614: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: PZ52639
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: RB12034
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: PZ93737
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ93737%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for PZ93737: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: UA37690
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: ED77139
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: FF45161
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: RM13688
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: KU06425
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: GV49335
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV49335%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for GV49335: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: ZL07806
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL07806%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for ZL07806: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: XG74352
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG74352%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for XG74352: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: JV69341
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: AZ64167
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ64167%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for AZ64167: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: JR54731
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR54731%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for JR54731: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: EH51725
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH51725%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for EH51725: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: BD88975
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD88975%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for BD88975: 0
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: SK38422
2026-03-30 09:12:54 [auto1.it] INFO: Found listing with ID: YW35893
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW35893%27 HTTP/1.1" 200 None
2026-03-30 09:12:54 [auto1.it] INFO: Scrape type for YW35893: 0
2026-03-30 09:12:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:55 [auto1.it] INFO: Channel: 24h | Page: 57 | totalHits: 3315 | hits on page: 40
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: TG42626
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG42626%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for TG42626: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: MP39083
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP39083%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for MP39083: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: WN42286
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN42286%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for WN42286: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: XB00155
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB00155%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for XB00155: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: UZ24825
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ24825%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for UZ24825: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: XX37698
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: PL52224
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: DU17366
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: YG69242
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: WT33776
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT33776%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for WT33776: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: JH67201
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: JU08968
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: RG08940
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: PM46324
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: KZ30481
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ30481%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for KZ30481: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: RS22306
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS22306%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for RS22306: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: JD45338
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: RU70753
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU70753%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for RU70753: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: NP16593
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP16593%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for NP16593: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: JT23346
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT23346%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for JT23346: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: RB23819
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: AW98600
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: ZC00549
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: TJ20772
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ20772%27 HTTP/1.1" 200 None
2026-03-30 09:12:55 [auto1.it] INFO: Scrape type for TJ20772: 0
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: KB15233
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: ML96661
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: AR12639
2026-03-30 09:12:55 [auto1.it] INFO: Found listing with ID: JM76846
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM76846%27 HTTP/1.1" 200 None
2026-03-30 09:12:56 [auto1.it] INFO: Scrape type for JM76846: 0
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: DX27899
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: UT67830
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT67830%27 HTTP/1.1" 200 None
2026-03-30 09:12:56 [auto1.it] INFO: Scrape type for UT67830: 0
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: RU27646
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU27646%27 HTTP/1.1" 200 None
2026-03-30 09:12:56 [auto1.it] INFO: Scrape type for RU27646: 0
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: UE02945
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: XY73038
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: WM78801
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM78801%27 HTTP/1.1" 200 None
2026-03-30 09:12:56 [auto1.it] INFO: Scrape type for WM78801: 0
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: TZ26377
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ26377%27 HTTP/1.1" 200 None
2026-03-30 09:12:56 [auto1.it] INFO: Scrape type for TZ26377: 0
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: RJ37840
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ37840%27 HTTP/1.1" 200 None
2026-03-30 09:12:56 [auto1.it] INFO: Scrape type for RJ37840: 0
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: VM43481
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: FL08980
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: EG41470
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG41470%27 HTTP/1.1" 200 None
2026-03-30 09:12:56 [auto1.it] INFO: Scrape type for EG41470: 0
2026-03-30 09:12:56 [auto1.it] INFO: Found listing with ID: HL58093
2026-03-30 09:12:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:57 [auto1.it] INFO: Channel: 24h | Page: 58 | totalHits: 3315 | hits on page: 40
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: TZ47815
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: ST20254
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: BB73520
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: XJ82802
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: WK74495
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: ZM35614
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM35614%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for ZM35614: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: VC06734
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC06734%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for VC06734: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: YY46039
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY46039%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for YY46039: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: CV81447
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: MD08971
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD08971%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for MD08971: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: XN19179
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN19179%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for XN19179: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: YU91907
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: JJ50665
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ50665%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for JJ50665: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: KY69981
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY69981%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for KY69981: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: HN39146
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN39146%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for HN39146: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: MG67619
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG67619%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for MG67619: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: YA22905
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA22905%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for YA22905: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: YG30728
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: PU63843
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU63843%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for PU63843: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: SW30840
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW30840%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for SW30840: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: LK86303
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: LX64348
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX64348%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for LX64348: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: CG66796
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: UK17345
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: ZP08653
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP08653%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for ZP08653: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: WU48456
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: WW68303
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW68303%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for WW68303: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: LT86375
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT86375%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for LT86375: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: PG53512
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG53512%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for PG53512: 0
2026-03-30 09:12:57 [auto1.it] INFO: Found listing with ID: RK63045
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK63045%27 HTTP/1.1" 200 None
2026-03-30 09:12:57 [auto1.it] INFO: Scrape type for RK63045: 2
2026-03-30 09:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e566514-e77a-5add-b2aa-5579efd1c257 with identifier: RK63045
2026-03-30 09:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e566514-e77a-5add-b2aa-5579efd1c257 with scrape type 2
2026-03-30 09:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e566514-e77a-5add-b2aa-5579efd1c257 with scrape type 2
2026-03-30 09:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e566514-e77a-5add-b2aa-5579efd1c257, identifier: RK63045
2026-03-30 09:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e566514-e77a-5add-b2aa-5579efd1c257 with identifier: RK63045
2026-03-30 09:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e566514-e77a-5add-b2aa-5579efd1c257 with identifier: RK63045
2026-03-30 09:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e566514-e77a-5add-b2aa-5579efd1c257 with identifier: RK63045 to the API
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:12:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:35:13Z',
 'fuel_type': 'gas',
 'id': '2e566514-e77a-5add-b2aa-5579efd1c257',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK63045',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 124976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-17',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic GPL',
 'transmission': 'manual',
 'trim': 'Dynamic GPL',
 'year': 2009}
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK63045%27 HTTP/1.1" 200 None
2026-03-30 09:12:58 [auto1.it] INFO: Saving data for RK63045: {'auction_closing_time': 1774884913.0, 'created_time': 1774670954.479107, 'last_price_update_time': 1774861978.396863}
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RK63045') HTTP/1.1" 204 0
2026-03-30 09:12:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:12:58 [auto1.it] INFO: Found listing with ID: SB68054
2026-03-30 09:12:58 [auto1.it] INFO: Found listing with ID: NF38082
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF38082%27 HTTP/1.1" 200 None
2026-03-30 09:12:58 [auto1.it] INFO: Scrape type for NF38082: 0
2026-03-30 09:12:58 [auto1.it] INFO: Found listing with ID: BE98345
2026-03-30 09:12:58 [auto1.it] INFO: Found listing with ID: YB60466
2026-03-30 09:12:58 [auto1.it] INFO: Found listing with ID: RA25408
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2026-03-30 09:12:58 [auto1.it] INFO: Scrape type for RA25408: 0
2026-03-30 09:12:58 [auto1.it] INFO: Found listing with ID: YB05417
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB05417%27 HTTP/1.1" 200 None
2026-03-30 09:12:58 [auto1.it] INFO: Scrape type for YB05417: 0
2026-03-30 09:12:58 [auto1.it] INFO: Found listing with ID: AF81201
2026-03-30 09:12:58 [auto1.it] INFO: Found listing with ID: PT68883
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT68883%27 HTTP/1.1" 200 None
2026-03-30 09:12:58 [auto1.it] INFO: Scrape type for PT68883: 0
2026-03-30 09:12:58 [auto1.it] INFO: Found listing with ID: YH73900
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH73900%27 HTTP/1.1" 200 None
2026-03-30 09:12:58 [auto1.it] INFO: Scrape type for YH73900: 0
2026-03-30 09:12:58 [auto1.it] INFO: Found listing with ID: XC56824
2026-03-30 09:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:12:59 [auto1.it] INFO: Channel: 24h | Page: 59 | totalHits: 3315 | hits on page: 40
2026-03-30 09:12:59 [auto1.it] INFO: Found listing with ID: LH69939
2026-03-30 09:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH69939%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for LH69939: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: FA93618
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA93618%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for FA93618: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: LD48805
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD48805%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for LD48805: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: GR86359
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: BR14904
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR14904%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for BR14904: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: HX42058
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX42058%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for HX42058: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: BN39787
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN39787%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for BN39787: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: LZ05951
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: HC78741
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: FX50490
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: DU09881
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: EF98667
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: SR46685
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: TA87203
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA87203%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for TA87203: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: DW89993
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW89993%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for DW89993: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: TB60435
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB60435%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for TB60435: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: GM11383
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: ZJ09783
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ09783%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for ZJ09783: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: GG79286
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG79286%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for GG79286: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: KC12001
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: NB15044
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: VG33831
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG33831%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for VG33831: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: SL84548
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL84548%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for SL84548: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: FP61129
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: ZV75074
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV75074%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for ZV75074: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: JZ46948
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ46948%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for JZ46948: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: DZ84756
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ84756%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for DZ84756: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: GU38190
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: CF35894
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: DC62247
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC62247%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for DC62247: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: KD87590
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD87590%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for KD87590: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: VY00315
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: JH32473
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH32473%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for JH32473: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: VG76075
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG76075%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for VG76075: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: HW82018
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW82018%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for HW82018: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: KA98059
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA98059%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for KA98059: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: UB96617
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: FL87170
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL87170%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for FL87170: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: RF11851
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF11851%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for RF11851: 0
2026-03-30 09:13:00 [auto1.it] INFO: Found listing with ID: HC78855
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC78855%27 HTTP/1.1" 200 None
2026-03-30 09:13:00 [auto1.it] INFO: Scrape type for HC78855: 0
2026-03-30 09:13:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:01 [auto1.it] INFO: Channel: 24h | Page: 60 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:01 [auto1.it] INFO: Found listing with ID: VF62325
2026-03-30 09:13:01 [auto1.it] INFO: Found listing with ID: NU40150
2026-03-30 09:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU40150%27 HTTP/1.1" 200 None
2026-03-30 09:13:01 [auto1.it] INFO: Scrape type for NU40150: 0
2026-03-30 09:13:01 [auto1.it] INFO: Found listing with ID: KT00361
2026-03-30 09:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT00361%27 HTTP/1.1" 200 None
2026-03-30 09:13:01 [auto1.it] INFO: Scrape type for KT00361: 2
2026-03-30 09:13:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 543816d6-f030-5130-b5f1-c70c24dd7a0e with identifier: KT00361
2026-03-30 09:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 543816d6-f030-5130-b5f1-c70c24dd7a0e with scrape type 2
2026-03-30 09:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 543816d6-f030-5130-b5f1-c70c24dd7a0e with scrape type 2
2026-03-30 09:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 543816d6-f030-5130-b5f1-c70c24dd7a0e, identifier: KT00361
2026-03-30 09:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 543816d6-f030-5130-b5f1-c70c24dd7a0e with identifier: KT00361
2026-03-30 09:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 543816d6-f030-5130-b5f1-c70c24dd7a0e with identifier: KT00361
2026-03-30 09:13:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 543816d6-f030-5130-b5f1-c70c24dd7a0e with identifier: KT00361 to the API
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:50:14Z',
 'fuel_type': 'hybrid',
 'id': '543816d6-f030-5130-b5f1-c70c24dd7a0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT00361',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 46971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-30',
 'seller_name': None,
 'title': 'Honda HR-V 1.5 i-MMD Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2023}
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT00361%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Saving data for KT00361: {'auction_closing_time': 1774885814.0, 'created_time': 1774670957.511229, 'last_price_update_time': 1774861982.368427}
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT00361') HTTP/1.1" 204 0
2026-03-30 09:13:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: HA02667
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA02667%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for HA02667: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: ZF04289
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF04289%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for ZF04289: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: NC40954
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: UZ24263
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: LY33062
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: WF98355
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF98355%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for WF98355: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: RY75551
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY75551%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for RY75551: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: GT17174
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: PW10693
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW10693%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for PW10693: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: RV11940
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: RA84354
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: CC08861
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: SP14530
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: TH32608
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: WH70643
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: ZJ87985
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: RF43689
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF43689%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for RF43689: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: BV06574
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: US24028
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US24028%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for US24028: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: AS07739
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS07739%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for AS07739: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: DC13549
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: DW68997
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: VB18666
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB18666%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for VB18666: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: YT14284
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: ND31908
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND31908%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for ND31908: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: XJ18858
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ18858%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for XJ18858: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: NP40750
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP40750%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for NP40750: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: RS54948
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS54948%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for RS54948: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: UP03227
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: ZK89803
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: MY00561
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: XJ13084
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ13084%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for XJ13084: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: VT42722
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT42722%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for VT42722: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: VD09142
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: VP48054
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP48054%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for VP48054: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: FU99331
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU99331%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for FU99331: 0
2026-03-30 09:13:02 [auto1.it] INFO: Found listing with ID: DS02463
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS02463%27 HTTP/1.1" 200 None
2026-03-30 09:13:02 [auto1.it] INFO: Scrape type for DS02463: 0
2026-03-30 09:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:03 [auto1.it] INFO: Channel: 24h | Page: 61 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: WL66559
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL66559%27 HTTP/1.1" 200 None
2026-03-30 09:13:03 [auto1.it] INFO: Scrape type for WL66559: 0
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: JW95602
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: ZE21394
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE21394%27 HTTP/1.1" 200 None
2026-03-30 09:13:03 [auto1.it] INFO: Scrape type for ZE21394: 0
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: JF95895
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF95895%27 HTTP/1.1" 200 None
2026-03-30 09:13:03 [auto1.it] INFO: Scrape type for JF95895: 0
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: KM59258
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM59258%27 HTTP/1.1" 200 None
2026-03-30 09:13:03 [auto1.it] INFO: Scrape type for KM59258: 0
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: ZU06634
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: DT24064
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT24064%27 HTTP/1.1" 200 None
2026-03-30 09:13:03 [auto1.it] INFO: Scrape type for DT24064: 0
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: RM50913
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: CY97706
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: TY61219
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: VV63992
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV63992%27 HTTP/1.1" 200 None
2026-03-30 09:13:03 [auto1.it] INFO: Scrape type for VV63992: 0
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: DD55036
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: PM10461
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM10461%27 HTTP/1.1" 200 None
2026-03-30 09:13:03 [auto1.it] INFO: Scrape type for PM10461: 0
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: JN19530
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN19530%27 HTTP/1.1" 200 None
2026-03-30 09:13:03 [auto1.it] INFO: Scrape type for JN19530: 0
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: FS34329
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: PV13410
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: AV12122
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV12122%27 HTTP/1.1" 200 None
2026-03-30 09:13:03 [auto1.it] INFO: Scrape type for AV12122: 0
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: ZZ56254
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ56254%27 HTTP/1.1" 200 None
2026-03-30 09:13:03 [auto1.it] INFO: Scrape type for ZZ56254: 0
2026-03-30 09:13:03 [auto1.it] INFO: Found listing with ID: UN43339
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN43339%27 HTTP/1.1" 200 None
2026-03-30 09:13:03 [auto1.it] INFO: Scrape type for UN43339: 2
2026-03-30 09:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38eab39a-ca1b-581d-bf0c-d40865bf9f8b with identifier: UN43339
2026-03-30 09:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38eab39a-ca1b-581d-bf0c-d40865bf9f8b with scrape type 2
2026-03-30 09:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38eab39a-ca1b-581d-bf0c-d40865bf9f8b with scrape type 2
2026-03-30 09:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 38eab39a-ca1b-581d-bf0c-d40865bf9f8b, identifier: UN43339
2026-03-30 09:13:04 [scrapy.extensions.logstats] INFO: Crawled 313 pages (at 28 pages/min), scraped 567 items (at 21 items/min)
2026-03-30 09:13:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 09:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 38eab39a-ca1b-581d-bf0c-d40865bf9f8b with identifier: UN43339
2026-03-30 09:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 38eab39a-ca1b-581d-bf0c-d40865bf9f8b with identifier: UN43339
2026-03-30 09:13:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 38eab39a-ca1b-581d-bf0c-d40865bf9f8b with identifier: UN43339 to the API
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:39Z',
 'fuel_type': 'diesel',
 'id': '38eab39a-ca1b-581d-bf0c-d40865bf9f8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN43339',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 147723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-28',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2021}
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN43339%27 HTTP/1.1" 200 None
2026-03-30 09:13:04 [auto1.it] INFO: Saving data for UN43339: {'auction_closing_time': 1774886259.0, 'created_time': 1773781727.463126, 'last_price_update_time': 1774861984.440978}
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UN43339') HTTP/1.1" 204 0
2026-03-30 09:13:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: PV39557
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: ZE71737
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE71737%27 HTTP/1.1" 200 None
2026-03-30 09:13:04 [auto1.it] INFO: Scrape type for ZE71737: 0
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: FP75199
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP75199%27 HTTP/1.1" 200 None
2026-03-30 09:13:04 [auto1.it] INFO: Scrape type for FP75199: 0
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: HH07211
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: FY46493
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY46493%27 HTTP/1.1" 200 None
2026-03-30 09:13:04 [auto1.it] INFO: Scrape type for FY46493: 0
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: GJ95983
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: NZ40909
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ40909%27 HTTP/1.1" 200 None
2026-03-30 09:13:04 [auto1.it] INFO: Scrape type for NZ40909: 0
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: AF82865
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF82865%27 HTTP/1.1" 200 None
2026-03-30 09:13:04 [auto1.it] INFO: Scrape type for AF82865: 0
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: LG18660
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG18660%27 HTTP/1.1" 200 None
2026-03-30 09:13:04 [auto1.it] INFO: Scrape type for LG18660: 0
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: SE98453
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: TJ64738
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: UB44414
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: EU82988
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU82988%27 HTTP/1.1" 200 None
2026-03-30 09:13:04 [auto1.it] INFO: Scrape type for EU82988: 0
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: SM22245
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: LD41720
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: DL42775
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL42775%27 HTTP/1.1" 200 None
2026-03-30 09:13:04 [auto1.it] INFO: Scrape type for DL42775: 0
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: DP88225
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: JJ49663
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: GV75261
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV75261%27 HTTP/1.1" 200 None
2026-03-30 09:13:04 [auto1.it] INFO: Scrape type for GV75261: 0
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: LZ50355
2026-03-30 09:13:04 [auto1.it] INFO: Found listing with ID: TA75240
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA75240%27 HTTP/1.1" 200 None
2026-03-30 09:13:04 [auto1.it] INFO: Scrape type for TA75240: 0
2026-03-30 09:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:05 [auto1.it] INFO: Channel: 24h | Page: 62 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: DB04877
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: XV39349
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV39349%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for XV39349: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: CN31542
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN31542%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for CN31542: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: BV97691
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: UA89499
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA89499%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for UA89499: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: HZ93936
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: LV04843
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: WA74830
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74830%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for WA74830: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: FS29770
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS29770%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for FS29770: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: KD78044
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: LG36476
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: BY06123
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: TD31675
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD31675%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for TD31675: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: DV58522
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV58522%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for DV58522: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: TV19217
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: UB21320
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: HD69394
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD69394%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for HD69394: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: PM68240
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: CH03473
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH03473%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for CH03473: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: TE47770
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE47770%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for TE47770: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: BZ06099
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ06099%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for BZ06099: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: SS52204
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS52204%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for SS52204: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: HX75119
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: PT89621
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: ZL28386
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: KR37794
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR37794%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for KR37794: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: HY34989
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: XV25356
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25356%27 HTTP/1.1" 200 None
2026-03-30 09:13:05 [auto1.it] INFO: Scrape type for XV25356: 0
2026-03-30 09:13:05 [auto1.it] INFO: Found listing with ID: FP20263
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP20263%27 HTTP/1.1" 200 None
2026-03-30 09:13:06 [auto1.it] INFO: Scrape type for FP20263: 0
2026-03-30 09:13:06 [auto1.it] INFO: Found listing with ID: RL97939
2026-03-30 09:13:06 [auto1.it] INFO: Found listing with ID: JY70774
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY70774%27 HTTP/1.1" 200 None
2026-03-30 09:13:06 [auto1.it] INFO: Scrape type for JY70774: 0
2026-03-30 09:13:06 [auto1.it] INFO: Found listing with ID: UY39151
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY39151%27 HTTP/1.1" 200 None
2026-03-30 09:13:06 [auto1.it] INFO: Scrape type for UY39151: 0
2026-03-30 09:13:06 [auto1.it] INFO: Found listing with ID: UP17064
2026-03-30 09:13:06 [auto1.it] INFO: Found listing with ID: TT52453
2026-03-30 09:13:06 [auto1.it] INFO: Found listing with ID: UR73173
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR73173%27 HTTP/1.1" 200 None
2026-03-30 09:13:06 [auto1.it] INFO: Scrape type for UR73173: 0
2026-03-30 09:13:06 [auto1.it] INFO: Found listing with ID: DL97052
2026-03-30 09:13:06 [auto1.it] INFO: Found listing with ID: SM29752
2026-03-30 09:13:06 [auto1.it] INFO: Found listing with ID: WW47132
2026-03-30 09:13:06 [auto1.it] INFO: Found listing with ID: PJ46449
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ46449%27 HTTP/1.1" 200 None
2026-03-30 09:13:06 [auto1.it] INFO: Scrape type for PJ46449: 0
2026-03-30 09:13:06 [auto1.it] INFO: Found listing with ID: DX25254
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX25254%27 HTTP/1.1" 200 None
2026-03-30 09:13:06 [auto1.it] INFO: Scrape type for DX25254: 0
2026-03-30 09:13:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:10 [auto1.it] INFO: Channel: 24h | Page: 63 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: DX82404
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX82404%27 HTTP/1.1" 200 None
2026-03-30 09:13:10 [auto1.it] INFO: Scrape type for DX82404: 0
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: PK74621
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: MJ86480
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ86480%27 HTTP/1.1" 200 None
2026-03-30 09:13:10 [auto1.it] INFO: Scrape type for MJ86480: 0
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: AR18622
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR18622%27 HTTP/1.1" 200 None
2026-03-30 09:13:10 [auto1.it] INFO: Scrape type for AR18622: 0
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: MZ58050
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: RB26067
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: XZ72452
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ72452%27 HTTP/1.1" 200 None
2026-03-30 09:13:10 [auto1.it] INFO: Scrape type for XZ72452: 0
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: TR59701
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: NV87278
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: SX19566
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: SJ09087
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: HY91699
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY91699%27 HTTP/1.1" 200 None
2026-03-30 09:13:10 [auto1.it] INFO: Scrape type for HY91699: 0
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: YT66548
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT66548%27 HTTP/1.1" 200 None
2026-03-30 09:13:10 [auto1.it] INFO: Scrape type for YT66548: 0
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: FD12268
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: ZR48768
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: CB66149
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: RE68635
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: UM17769
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM17769%27 HTTP/1.1" 200 None
2026-03-30 09:13:10 [auto1.it] INFO: Scrape type for UM17769: 0
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: HW61207
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW61207%27 HTTP/1.1" 200 None
2026-03-30 09:13:10 [auto1.it] INFO: Scrape type for HW61207: 0
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: GA57810
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: VD70212
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: JK09197
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK09197%27 HTTP/1.1" 200 None
2026-03-30 09:13:10 [auto1.it] INFO: Scrape type for JK09197: 0
2026-03-30 09:13:10 [auto1.it] INFO: Found listing with ID: CA31078
2026-03-30 09:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA31078%27 HTTP/1.1" 200 None
2026-03-30 09:13:11 [auto1.it] INFO: Scrape type for CA31078: 0
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: UN97193
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: JS13846
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS13846%27 HTTP/1.1" 200 None
2026-03-30 09:13:11 [auto1.it] INFO: Scrape type for JS13846: 0
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: JT98079
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: ZN14128
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN14128%27 HTTP/1.1" 200 None
2026-03-30 09:13:11 [auto1.it] INFO: Scrape type for ZN14128: 0
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: HS75428
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: GA45330
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA45330%27 HTTP/1.1" 200 None
2026-03-30 09:13:11 [auto1.it] INFO: Scrape type for GA45330: 0
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: LR95961
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: UU49973
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU49973%27 HTTP/1.1" 200 None
2026-03-30 09:13:11 [auto1.it] INFO: Scrape type for UU49973: 0
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: EB11724
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB11724%27 HTTP/1.1" 200 None
2026-03-30 09:13:11 [auto1.it] INFO: Scrape type for EB11724: 0
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: WY28975
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: XP84134
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP84134%27 HTTP/1.1" 200 None
2026-03-30 09:13:11 [auto1.it] INFO: Scrape type for XP84134: 0
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: RV64880
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64880%27 HTTP/1.1" 200 None
2026-03-30 09:13:11 [auto1.it] INFO: Scrape type for RV64880: 0
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: XH17321
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH17321%27 HTTP/1.1" 200 None
2026-03-30 09:13:11 [auto1.it] INFO: Scrape type for XH17321: 0
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: ES64600
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES64600%27 HTTP/1.1" 200 None
2026-03-30 09:13:11 [auto1.it] INFO: Scrape type for ES64600: 0
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: TG93645
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: XY26314
2026-03-30 09:13:11 [auto1.it] INFO: Found listing with ID: XJ87572
2026-03-30 09:13:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:12 [auto1.it] INFO: Channel: 24h | Page: 64 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: DV39460
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: CP04601
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: KV97590
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV97590%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for KV97590: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: PR97766
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: NT74531
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: BF34891
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF34891%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for BF34891: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: CA25129
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: DV62458
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: JF27717
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: NP04036
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: RX07844
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX07844%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for RX07844: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: LF46608
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF46608%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for LF46608: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: TS59592
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: KT26389
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT26389%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for KT26389: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: FF22275
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: RZ99853
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: NB02604
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB02604%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for NB02604: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: RU45122
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: GY05881
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: TT28559
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT28559%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for TT28559: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: MY33245
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY33245%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for MY33245: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: BG42211
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG42211%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for BG42211: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: BK04078
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK04078%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for BK04078: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: AY46194
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY46194%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for AY46194: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: MW84295
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: YY01932
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: ED17590
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: GT34435
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: SC91639
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC91639%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for SC91639: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: VA29565
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA29565%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for VA29565: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: BG55667
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG55667%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for BG55667: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: PD51522
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD51522%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for PD51522: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: CH35422
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: FK45797
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK45797%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for FK45797: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: RA11036
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: AC52318
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC52318%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for AC52318: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: DS09153
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS09153%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for DS09153: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: TF37027
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF37027%27 HTTP/1.1" 200 None
2026-03-30 09:13:12 [auto1.it] INFO: Scrape type for TF37027: 0
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: DW71358
2026-03-30 09:13:12 [auto1.it] INFO: Found listing with ID: CA07197
2026-03-30 09:13:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:13 [auto1.it] INFO: Channel: 24h | Page: 65 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: AA46193
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: XY19791
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY19791%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for XY19791: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: FB26923
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: KA77498
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: PP30320
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP30320%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for PP30320: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: GW20586
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: DV74338
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV74338%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for DV74338: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: WB02542
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB02542%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for WB02542: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: PK39445
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK39445%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for PK39445: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: XX93100
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: AM26734
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: SX21241
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: NC70942
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: HM03162
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: AD83412
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD83412%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for AD83412: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: SK74491
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK74491%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for SK74491: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: HL13838
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL13838%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for HL13838: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: LY98983
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: TZ05140
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ05140%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for TZ05140: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: EA08863
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: SP76043
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: TP07930
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: NJ20872
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: VF45343
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: UH24894
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: CA11723
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: SB88786
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB88786%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for SB88786: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: UC27147
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: BA15195
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA15195%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for BA15195: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: FW75637
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: NT25208
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: XK39914
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK39914%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for XK39914: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: FM41301
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: KN82468
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN82468%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for KN82468: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: PT72554
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT72554%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for PT72554: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: SK80279
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK80279%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for SK80279: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: TP30919
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP30919%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for TP30919: 0
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: XT40512
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: BE00528
2026-03-30 09:13:13 [auto1.it] INFO: Found listing with ID: EE91281
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE91281%27 HTTP/1.1" 200 None
2026-03-30 09:13:13 [auto1.it] INFO: Scrape type for EE91281: 0
2026-03-30 09:13:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:15 [auto1.it] INFO: Channel: 24h | Page: 66 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: DP98700
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: TX96321
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: RP23530
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: JC41210
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: KW78911
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW78911%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for KW78911: 0
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: XX72461
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: AJ45475
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ45475%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for AJ45475: 0
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: RB61179
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: RA46767
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA46767%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for RA46767: 0
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: NK94790
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: GE08005
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: GM28799
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM28799%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for GM28799: 0
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: NP81459
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP81459%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for NP81459: 0
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: KD77242
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD77242%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for KD77242: 0
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: BH96807
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: DZ90619
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ90619%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for DZ90619: 0
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: BT34353
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT34353%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for BT34353: 0
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: GR65234
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: EV67651
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV67651%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for EV67651: 0
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: RT31033
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT31033%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for RT31033: 0
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: ZX88730
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: DA14696
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA14696%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for DA14696: 0
2026-03-30 09:13:15 [auto1.it] INFO: Found listing with ID: GY24745
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY24745%27 HTTP/1.1" 200 None
2026-03-30 09:13:15 [auto1.it] INFO: Scrape type for GY24745: 2
2026-03-30 09:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49cce838-7a49-50e4-a2b0-abc24d36c8b6 with identifier: GY24745
2026-03-30 09:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49cce838-7a49-50e4-a2b0-abc24d36c8b6 with scrape type 2
2026-03-30 09:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49cce838-7a49-50e4-a2b0-abc24d36c8b6 with scrape type 2
2026-03-30 09:13:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49cce838-7a49-50e4-a2b0-abc24d36c8b6, identifier: GY24745
2026-03-30 09:13:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49cce838-7a49-50e4-a2b0-abc24d36c8b6 with identifier: GY24745
2026-03-30 09:13:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49cce838-7a49-50e4-a2b0-abc24d36c8b6 with identifier: GY24745
2026-03-30 09:13:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49cce838-7a49-50e4-a2b0-abc24d36c8b6 with identifier: GY24745 to the API
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:10:06Z',
 'fuel_type': 'petrol',
 'id': '49cce838-7a49-50e4-a2b0-abc24d36c8b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY24745',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 147286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-09',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Cosmo ecoFlex',
 'transmission': 'manual',
 'trim': 'Cosmo ecoFlex',
 'year': 2015}
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY24745%27 HTTP/1.1" 200 None
2026-03-30 09:13:16 [auto1.it] INFO: Saving data for GY24745: {'auction_closing_time': 1774883406.0, 'created_time': 1774670951.970953, 'last_price_update_time': 1774861996.375992}
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GY24745') HTTP/1.1" 204 0
2026-03-30 09:13:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: BT51990
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: BX71767
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX71767%27 HTTP/1.1" 200 None
2026-03-30 09:13:16 [auto1.it] INFO: Scrape type for BX71767: 0
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: KR27714
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR27714%27 HTTP/1.1" 200 None
2026-03-30 09:13:16 [auto1.it] INFO: Scrape type for KR27714: 0
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: NY71286
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY71286%27 HTTP/1.1" 200 None
2026-03-30 09:13:16 [auto1.it] INFO: Scrape type for NY71286: 0
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: LN65398
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN65398%27 HTTP/1.1" 200 None
2026-03-30 09:13:16 [auto1.it] INFO: Scrape type for LN65398: 0
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: HR92713
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: ZF40554
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: MK90568
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: SX13991
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: FU47372
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: FG90237
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: FF25963
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF25963%27 HTTP/1.1" 200 None
2026-03-30 09:13:16 [auto1.it] INFO: Scrape type for FF25963: 0
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: NT36373
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT36373%27 HTTP/1.1" 200 None
2026-03-30 09:13:16 [auto1.it] INFO: Scrape type for NT36373: 0
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: MK89859
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK89859%27 HTTP/1.1" 200 None
2026-03-30 09:13:16 [auto1.it] INFO: Scrape type for MK89859: 0
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: EU08042
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU08042%27 HTTP/1.1" 200 None
2026-03-30 09:13:16 [auto1.it] INFO: Scrape type for EU08042: 0
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: RT93241
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT93241%27 HTTP/1.1" 200 None
2026-03-30 09:13:16 [auto1.it] INFO: Scrape type for RT93241: 0
2026-03-30 09:13:16 [auto1.it] INFO: Found listing with ID: VS63057
2026-03-30 09:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:17 [auto1.it] INFO: Channel: 24h | Page: 67 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: TT73216
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT73216%27 HTTP/1.1" 200 None
2026-03-30 09:13:17 [auto1.it] INFO: Scrape type for TT73216: 0
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: DM50235
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM50235%27 HTTP/1.1" 200 None
2026-03-30 09:13:17 [auto1.it] INFO: Scrape type for DM50235: 0
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: XY06195
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: KB99828
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: AP47784
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP47784%27 HTTP/1.1" 200 None
2026-03-30 09:13:17 [auto1.it] INFO: Scrape type for AP47784: 0
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: ER28485
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER28485%27 HTTP/1.1" 200 None
2026-03-30 09:13:17 [auto1.it] INFO: Scrape type for ER28485: 0
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: WL39771
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL39771%27 HTTP/1.1" 200 None
2026-03-30 09:13:17 [auto1.it] INFO: Scrape type for WL39771: 0
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: WY52867
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: RE49156
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: GB11317
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: SS74594
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS74594%27 HTTP/1.1" 200 None
2026-03-30 09:13:17 [auto1.it] INFO: Scrape type for SS74594: 0
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: YR57836
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR57836%27 HTTP/1.1" 200 None
2026-03-30 09:13:17 [auto1.it] INFO: Scrape type for YR57836: 0
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: ZY29551
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: VB10041
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB10041%27 HTTP/1.1" 200 None
2026-03-30 09:13:17 [auto1.it] INFO: Scrape type for VB10041: 0
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: VS88689
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS88689%27 HTTP/1.1" 200 None
2026-03-30 09:13:17 [auto1.it] INFO: Scrape type for VS88689: 0
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: MH63316
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH63316%27 HTTP/1.1" 200 None
2026-03-30 09:13:17 [auto1.it] INFO: Scrape type for MH63316: 0
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: KE74592
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: NE32372
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: WG36727
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: AA65111
2026-03-30 09:13:17 [auto1.it] INFO: Found listing with ID: FG22478
2026-03-30 09:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG22478%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for FG22478: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: FD53627
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD53627%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for FD53627: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: UE69721
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE69721%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for UE69721: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: RZ31848
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: XH35372
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH35372%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for XH35372: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: NY14439
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY14439%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for NY14439: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: YG79824
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: FA25945
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA25945%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for FA25945: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: TP79080
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: JC61958
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: VV53069
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: ZW88781
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW88781%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for ZW88781: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: EX36920
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: RC55633
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC55633%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for RC55633: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: ZL56801
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL56801%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for ZL56801: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: DD75867
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: FN89798
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN89798%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for FN89798: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: ZU32516
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU32516%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for ZU32516: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: YY37168
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY37168%27 HTTP/1.1" 200 None
2026-03-30 09:13:18 [auto1.it] INFO: Scrape type for YY37168: 0
2026-03-30 09:13:18 [auto1.it] INFO: Found listing with ID: MK47318
2026-03-30 09:13:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:19 [auto1.it] INFO: Channel: 24h | Page: 68 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: PW61851
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW61851%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for PW61851: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: DF71809
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: PN84990
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN84990%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for PN84990: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: JT10117
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: EV28185
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV28185%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for EV28185: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: UH10100
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: MG40784
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: YX40722
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: HW99269
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW99269%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for HW99269: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: XV92434
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: KW23650
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: RE73183
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: EU31713
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: EK96047
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK96047%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for EK96047: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: SN24706
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: CT94493
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT94493%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for CT94493: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: HW38972
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW38972%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for HW38972: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: XW45727
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW45727%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for XW45727: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: NV14531
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: EA99644
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA99644%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for EA99644: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: WJ96008
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ96008%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for WJ96008: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: KM03539
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: SD99760
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: NH43496
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH43496%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for NH43496: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: LR80545
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR80545%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for LR80545: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: ST06974
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST06974%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for ST06974: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: YA38395
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA38395%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for YA38395: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: UV23225
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: AF86061
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF86061%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for AF86061: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: HA74709
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: HH71659
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH71659%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for HH71659: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: JD36680
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD36680%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for JD36680: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: XW11581
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW11581%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for XW11581: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: SM56678
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: FV08764
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV08764%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for FV08764: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: ZP43872
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: NT87512
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: HK76451
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK76451%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for HK76451: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: BR85251
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR85251%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for BR85251: 0
2026-03-30 09:13:19 [auto1.it] INFO: Found listing with ID: MJ56549
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ56549%27 HTTP/1.1" 200 None
2026-03-30 09:13:19 [auto1.it] INFO: Scrape type for MJ56549: 0
2026-03-30 09:13:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:20 [auto1.it] INFO: Channel: 24h | Page: 69 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: JZ41811
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: GT53480
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT53480%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for GT53480: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: RF78298
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF78298%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for RF78298: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: FE23339
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: CN60691
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN60691%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for CN60691: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: ZA31579
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: CM50151
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: VG20766
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: ZJ39070
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: AZ05187
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ05187%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for AZ05187: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: NF08896
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF08896%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for NF08896: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: CD59495
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: VY80184
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY80184%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for VY80184: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: PX04626
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX04626%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for PX04626: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: TH88339
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH88339%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for TH88339: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: ER97620
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER97620%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for ER97620: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: YW53472
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW53472%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for YW53472: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: HS43445
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS43445%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for HS43445: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: PH25620
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH25620%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for PH25620: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: DL31507
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL31507%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for DL31507: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: AD96495
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: YP66201
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: LN67507
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: GZ47839
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ47839%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for GZ47839: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: AR03634
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR03634%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for AR03634: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: TL02319
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL02319%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for TL02319: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: XE78357
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE78357%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for XE78357: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: BW07837
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW07837%27 HTTP/1.1" 200 None
2026-03-30 09:13:20 [auto1.it] INFO: Scrape type for BW07837: 0
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: MX32120
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: XZ55537
2026-03-30 09:13:20 [auto1.it] INFO: Found listing with ID: FE63733
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE63733%27 HTTP/1.1" 200 None
2026-03-30 09:13:21 [auto1.it] INFO: Scrape type for FE63733: 0
2026-03-30 09:13:21 [auto1.it] INFO: Found listing with ID: AK49270
2026-03-30 09:13:21 [auto1.it] INFO: Found listing with ID: TP02469
2026-03-30 09:13:21 [auto1.it] INFO: Found listing with ID: UC14598
2026-03-30 09:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC14598%27 HTTP/1.1" 200 None
2026-03-30 09:13:21 [auto1.it] INFO: Scrape type for UC14598: 0
2026-03-30 09:13:21 [auto1.it] INFO: Found listing with ID: RV10689
2026-03-30 09:13:21 [auto1.it] INFO: Found listing with ID: YV66151
2026-03-30 09:13:21 [auto1.it] INFO: Found listing with ID: NT18683
2026-03-30 09:13:21 [auto1.it] INFO: Found listing with ID: VH18457
2026-03-30 09:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH18457%27 HTTP/1.1" 200 None
2026-03-30 09:13:21 [auto1.it] INFO: Scrape type for VH18457: 0
2026-03-30 09:13:21 [auto1.it] INFO: Found listing with ID: PM85940
2026-03-30 09:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM85940%27 HTTP/1.1" 200 None
2026-03-30 09:13:21 [auto1.it] INFO: Scrape type for PM85940: 0
2026-03-30 09:13:21 [auto1.it] INFO: Found listing with ID: UK60459
2026-03-30 09:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK60459%27 HTTP/1.1" 200 None
2026-03-30 09:13:21 [auto1.it] INFO: Scrape type for UK60459: 0
2026-03-30 09:13:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:22 [auto1.it] INFO: Channel: 24h | Page: 70 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: XJ25634
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: TS00967
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: CZ11807
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ11807%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for CZ11807: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: HY82012
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY82012%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for HY82012: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: MY80647
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: BC50392
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: YD02421
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD02421%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for YD02421: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: RK76685
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: HJ04810
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: MR30902
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: JZ43112
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ43112%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for JZ43112: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: EF18991
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: PZ93263
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: YD31077
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: WK47884
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK47884%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for WK47884: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: GR46256
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR46256%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for GR46256: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: KR62960
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: BP72871
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP72871%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for BP72871: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: MN05358
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN05358%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for MN05358: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: NX49735
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: RM50163
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: TH60548
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH60548%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for TH60548: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: JM95977
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: SC57434
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC57434%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for SC57434: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: WM09394
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: NH87827
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: EP52133
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP52133%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for EP52133: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: PY38952
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY38952%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for PY38952: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: GZ68257
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ68257%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for GZ68257: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: CG38373
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG38373%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for CG38373: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: KN28324
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN28324%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for KN28324: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: SV68471
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: BH87833
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH87833%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for BH87833: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: NE29040
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE29040%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for NE29040: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: RK99012
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK99012%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for RK99012: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: NC22560
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC22560%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for NC22560: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: FC56913
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: VB76236
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB76236%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for VB76236: 0
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: TJ16144
2026-03-30 09:13:22 [auto1.it] INFO: Found listing with ID: MP38802
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP38802%27 HTTP/1.1" 200 None
2026-03-30 09:13:22 [auto1.it] INFO: Scrape type for MP38802: 0
2026-03-30 09:13:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:23 [auto1.it] INFO: Channel: 24h | Page: 71 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: KV55907
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: BZ51177
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ51177%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for BZ51177: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: CY56164
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY56164%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for CY56164: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: TB63135
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB63135%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for TB63135: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: ZK39903
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK39903%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for ZK39903: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: KZ13497
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: YX84472
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX84472%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for YX84472: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: AT73331
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: NW39959
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: YK98276
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK98276%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for YK98276: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: CJ64567
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: FK78904
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK78904%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for FK78904: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: JC35817
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC35817%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for JC35817: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: MC76570
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC76570%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for MC76570: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: ZC44432
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: BB49648
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: NC13614
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC13614%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for NC13614: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: GJ99640
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: TT70902
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT70902%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for TT70902: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: ZG26295
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG26295%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for ZG26295: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: CT59426
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT59426%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for CT59426: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: GK49763
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: EN63218
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN63218%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for EN63218: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: NM61203
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: PV47203
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV47203%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for PV47203: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: YE33932
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: JR36012
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: RS27725
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS27725%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for RS27725: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: XP44684
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP44684%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for XP44684: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: ML45383
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML45383%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for ML45383: 0
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: LJ23422
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: YM04373
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: MZ65778
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: TD58457
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: SB59466
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: BV17272
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: FE93281
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: EG33732
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: TR09676
2026-03-30 09:13:23 [auto1.it] INFO: Found listing with ID: SX65477
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX65477%27 HTTP/1.1" 200 None
2026-03-30 09:13:23 [auto1.it] INFO: Scrape type for SX65477: 0
2026-03-30 09:13:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:24 [auto1.it] INFO: Channel: 24h | Page: 72 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: DA98342
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: HB00898
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: NF72135
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF72135%27 HTTP/1.1" 200 None
2026-03-30 09:13:24 [auto1.it] INFO: Scrape type for NF72135: 0
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: XS00387
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS00387%27 HTTP/1.1" 200 None
2026-03-30 09:13:24 [auto1.it] INFO: Scrape type for XS00387: 0
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: AR49211
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: MD59623
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD59623%27 HTTP/1.1" 200 None
2026-03-30 09:13:24 [auto1.it] INFO: Scrape type for MD59623: 0
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: RN27083
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN27083%27 HTTP/1.1" 200 None
2026-03-30 09:13:24 [auto1.it] INFO: Scrape type for RN27083: 0
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: EZ67132
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: RG18197
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: AW19697
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW19697%27 HTTP/1.1" 200 None
2026-03-30 09:13:24 [auto1.it] INFO: Scrape type for AW19697: 0
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: UJ83864
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: XM71615
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM71615%27 HTTP/1.1" 200 None
2026-03-30 09:13:24 [auto1.it] INFO: Scrape type for XM71615: 0
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: AG42346
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: RR79025
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: AS99130
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: RH79013
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: JL18468
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: FP31020
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP31020%27 HTTP/1.1" 200 None
2026-03-30 09:13:24 [auto1.it] INFO: Scrape type for FP31020: 0
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: AV18402
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: ZF99216
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF99216%27 HTTP/1.1" 200 None
2026-03-30 09:13:24 [auto1.it] INFO: Scrape type for ZF99216: 0
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: WF32010
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: XH74376
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: EC03156
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: PD98498
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD98498%27 HTTP/1.1" 200 None
2026-03-30 09:13:24 [auto1.it] INFO: Scrape type for PD98498: 0
2026-03-30 09:13:24 [auto1.it] INFO: Found listing with ID: HJ07688
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ07688%27 HTTP/1.1" 200 None
2026-03-30 09:13:25 [auto1.it] INFO: Scrape type for HJ07688: 0
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: FF80511
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: UB92069
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: GU46238
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU46238%27 HTTP/1.1" 200 None
2026-03-30 09:13:25 [auto1.it] INFO: Scrape type for GU46238: 0
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: GS36896
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS36896%27 HTTP/1.1" 200 None
2026-03-30 09:13:25 [auto1.it] INFO: Scrape type for GS36896: 0
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: DK49031
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK49031%27 HTTP/1.1" 200 None
2026-03-30 09:13:25 [auto1.it] INFO: Scrape type for DK49031: 0
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: MN68562
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: RR38006
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: UW74676
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW74676%27 HTTP/1.1" 200 None
2026-03-30 09:13:25 [auto1.it] INFO: Scrape type for UW74676: 0
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: JZ66909
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: EW77307
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: HJ48011
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ48011%27 HTTP/1.1" 200 None
2026-03-30 09:13:25 [auto1.it] INFO: Scrape type for HJ48011: 0
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: PJ71432
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: HJ37635
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: UM30654
2026-03-30 09:13:25 [auto1.it] INFO: Found listing with ID: HY25299
2026-03-30 09:13:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:26 [auto1.it] INFO: Channel: 24h | Page: 73 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: RG33241
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: ZT77518
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT77518%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for ZT77518: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: KS29368
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS29368%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for KS29368: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: XS70804
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: EL95895
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: XP33889
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP33889%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for XP33889: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: BS70853
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS70853%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for BS70853: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: PP81137
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP81137%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for PP81137: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: AB11915
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: YT31818
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: LK77946
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK77946%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for LK77946: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: CV06620
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV06620%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for CV06620: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: CP91888
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: AT88859
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: WR49596
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: UT72595
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: WU25072
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU25072%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for WU25072: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: XP46027
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP46027%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for XP46027: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: ZS74487
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS74487%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for ZS74487: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: FP84024
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP84024%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for FP84024: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: HA91371
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA91371%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for HA91371: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: ZT94310
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT94310%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for ZT94310: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: YB21046
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB21046%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for YB21046: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: GY17675
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY17675%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for GY17675: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: HR28952
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR28952%27 HTTP/1.1" 200 None
2026-03-30 09:13:26 [auto1.it] INFO: Scrape type for HR28952: 0
2026-03-30 09:13:26 [auto1.it] INFO: Found listing with ID: CL50179
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL50179%27 HTTP/1.1" 200 None
2026-03-30 09:13:27 [auto1.it] INFO: Scrape type for CL50179: 0
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: AV05178
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: ZS11268
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: MR54744
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: VD19319
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: VR66407
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: MH80667
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: SH27035
2026-03-30 09:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH27035%27 HTTP/1.1" 200 None
2026-03-30 09:13:27 [auto1.it] INFO: Scrape type for SH27035: 0
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: AT94230
2026-03-30 09:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT94230%27 HTTP/1.1" 200 None
2026-03-30 09:13:27 [auto1.it] INFO: Scrape type for AT94230: 0
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: VZ01162
2026-03-30 09:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ01162%27 HTTP/1.1" 200 None
2026-03-30 09:13:27 [auto1.it] INFO: Scrape type for VZ01162: 0
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: KL53293
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: PC10788
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: UK65211
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: JP68462
2026-03-30 09:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP68462%27 HTTP/1.1" 200 None
2026-03-30 09:13:27 [auto1.it] INFO: Scrape type for JP68462: 0
2026-03-30 09:13:27 [auto1.it] INFO: Found listing with ID: PW02213
2026-03-30 09:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW02213%27 HTTP/1.1" 200 None
2026-03-30 09:13:27 [auto1.it] INFO: Scrape type for PW02213: 0
2026-03-30 09:13:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:28 [auto1.it] INFO: Channel: 24h | Page: 74 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: HK83461
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK83461%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for HK83461: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: YY73995
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY73995%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for YY73995: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: SA64006
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA64006%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for SA64006: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: CL59289
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL59289%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for CL59289: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: XG56779
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: MM92729
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: PN94511
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN94511%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for PN94511: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: SP64220
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: DC19091
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC19091%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for DC19091: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: CE88334
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: FP92305
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: WH54274
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: YA71285
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: ZZ46220
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ46220%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for ZZ46220: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: CW38322
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW38322%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for CW38322: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: LX63173
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: KV28875
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV28875%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for KV28875: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: RA59977
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA59977%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for RA59977: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: NF25875
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: KZ65568
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ65568%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for KZ65568: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: WJ04614
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ04614%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for WJ04614: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: GJ44194
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: JK37550
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK37550%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for JK37550: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: ZJ54266
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ54266%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for ZJ54266: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: TU97067
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU97067%27 HTTP/1.1" 200 None
2026-03-30 09:13:28 [auto1.it] INFO: Scrape type for TU97067: 0
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: NG25648
2026-03-30 09:13:28 [auto1.it] INFO: Found listing with ID: BR40244
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR40244%27 HTTP/1.1" 200 None
2026-03-30 09:13:29 [auto1.it] INFO: Scrape type for BR40244: 0
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: DN16039
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: AV77078
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: WA78117
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA78117%27 HTTP/1.1" 200 None
2026-03-30 09:13:29 [auto1.it] INFO: Scrape type for WA78117: 0
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: KJ64759
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: DV92182
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV92182%27 HTTP/1.1" 200 None
2026-03-30 09:13:29 [auto1.it] INFO: Scrape type for DV92182: 0
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: KS37590
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: SN56705
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN56705%27 HTTP/1.1" 200 None
2026-03-30 09:13:29 [auto1.it] INFO: Scrape type for SN56705: 0
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: RK00703
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: KM72059
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: NL56799
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: CZ11346
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ11346%27 HTTP/1.1" 200 None
2026-03-30 09:13:29 [auto1.it] INFO: Scrape type for CZ11346: 0
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: ZV36877
2026-03-30 09:13:29 [auto1.it] INFO: Found listing with ID: AW40388
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW40388%27 HTTP/1.1" 200 None
2026-03-30 09:13:29 [auto1.it] INFO: Scrape type for AW40388: 0
2026-03-30 09:13:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:30 [auto1.it] INFO: Channel: 24h | Page: 75 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: UR17084
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: DE71304
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE71304%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for DE71304: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: LA00570
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA00570%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for LA00570: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: ST97650
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST97650%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for ST97650: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: CD54959
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD54959%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for CD54959: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: ZH08694
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH08694%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for ZH08694: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: WN91380
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: RT10721
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT10721%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for RT10721: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: XL68174
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL68174%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for XL68174: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: NR40821
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: NR41367
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: DS09954
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: EF37813
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: CJ77239
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ77239%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for CJ77239: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: BT82313
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT82313%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for BT82313: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: MN04958
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: LR68259
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: WB58416
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB58416%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for WB58416: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: CS61296
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS61296%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for CS61296: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: HA26837
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: JE63706
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: CN51839
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: JR85955
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: MC18601
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: JH97185
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: SY20877
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: KT14926
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT14926%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for KT14926: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: SD18580
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD18580%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for SD18580: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: TW38851
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: RM24928
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM24928%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for RM24928: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: DF57379
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF57379%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for DF57379: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: XB46951
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: VG07643
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: UN20093
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN20093%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for UN20093: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: UT21803
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT21803%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for UT21803: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: RC42052
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC42052%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for RC42052: 0
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: YJ81563
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: JF24469
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: VZ90962
2026-03-30 09:13:30 [auto1.it] INFO: Found listing with ID: FR55532
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55532%27 HTTP/1.1" 200 None
2026-03-30 09:13:30 [auto1.it] INFO: Scrape type for FR55532: 0
2026-03-30 09:13:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:31 [auto1.it] INFO: Channel: 24h | Page: 76 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: BL56378
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL56378%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for BL56378: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: HF54587
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF54587%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for HF54587: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: AY76833
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY76833%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for AY76833: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: RJ05786
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: CV60870
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV60870%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for CV60870: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: PM98470
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM98470%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for PM98470: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: XT30792
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT30792%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for XT30792: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: HD11089
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: WM47642
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: KH13960
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: WS77593
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: KM48378
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM48378%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for KM48378: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: ET22397
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET22397%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for ET22397: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: TB64568
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB64568%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for TB64568: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: ZU99068
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU99068%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for ZU99068: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: VL91397
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: WG77442
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: LE72169
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: UR17462
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: DU34377
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU34377%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for DU34377: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: EV59116
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: UY41081
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: YN18335
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: NA95464
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA95464%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for NA95464: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: WA05506
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05506%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for WA05506: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: PW96424
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW96424%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for PW96424: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: CZ80815
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: YT14499
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: BU30300
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: WE07120
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE07120%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for WE07120: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: NF75023
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: VZ92626
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ92626%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for VZ92626: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: TF83722
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF83722%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for TF83722: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: BA01278
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA01278%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for BA01278: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: PW47751
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW47751%27 HTTP/1.1" 200 None
2026-03-30 09:13:31 [auto1.it] INFO: Scrape type for PW47751: 0
2026-03-30 09:13:31 [auto1.it] INFO: Found listing with ID: CU74500
2026-03-30 09:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU74500%27 HTTP/1.1" 200 None
2026-03-30 09:13:32 [auto1.it] INFO: Scrape type for CU74500: 0
2026-03-30 09:13:32 [auto1.it] INFO: Found listing with ID: SB06120
2026-03-30 09:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB06120%27 HTTP/1.1" 200 None
2026-03-30 09:13:32 [auto1.it] INFO: Scrape type for SB06120: 0
2026-03-30 09:13:32 [auto1.it] INFO: Found listing with ID: VC50043
2026-03-30 09:13:32 [auto1.it] INFO: Found listing with ID: ZK25339
2026-03-30 09:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25339%27 HTTP/1.1" 200 None
2026-03-30 09:13:32 [auto1.it] INFO: Scrape type for ZK25339: 0
2026-03-30 09:13:32 [auto1.it] INFO: Found listing with ID: ZX07478
2026-03-30 09:13:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:33 [auto1.it] INFO: Channel: 24h | Page: 77 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: VY27693
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY27693%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for VY27693: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: JZ77925
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ77925%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for JZ77925: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: YY84618
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: LN66513
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN66513%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for LN66513: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: CE47539
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE47539%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for CE47539: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: ET05908
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET05908%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for ET05908: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: YH77376
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: YF75384
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF75384%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for YF75384: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: YP53845
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP53845%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for YP53845: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: MU44225
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: DV89996
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV89996%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for DV89996: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: GC21308
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC21308%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for GC21308: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: WN69179
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN69179%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for WN69179: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: RT68139
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT68139%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for RT68139: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: GU07540
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU07540%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for GU07540: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: MJ56294
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ56294%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for MJ56294: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: RD34551
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: MX89615
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: DC79577
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: FJ19911
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: DP83591
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP83591%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for DP83591: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: DF10030
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF10030%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for DF10030: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: RF53888
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF53888%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for RF53888: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: XC35499
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: KW13943
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: CK02940
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: NW63690
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: CR10860
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR10860%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for CR10860: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: RZ14942
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: NE68522
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: HB76167
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: LW42205
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW42205%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for LW42205: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: JX99167
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: PB77964
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: PR01158
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR01158%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for PR01158: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: LU04143
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU04143%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for LU04143: 0
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: VX06371
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: XU75020
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: RT78827
2026-03-30 09:13:33 [auto1.it] INFO: Found listing with ID: ZX02617
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX02617%27 HTTP/1.1" 200 None
2026-03-30 09:13:33 [auto1.it] INFO: Scrape type for ZX02617: 0
2026-03-30 09:13:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:34 [auto1.it] INFO: Channel: 24h | Page: 78 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: GF04401
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: LF71839
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF71839%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for LF71839: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: KV81214
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV81214%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for KV81214: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: NZ66288
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: LC50167
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC50167%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for LC50167: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: RB44165
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: KG10642
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: VU78996
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU78996%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for VU78996: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: JC58161
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: NB09244
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: CG41342
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: XC50936
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50936%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for XC50936: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: PU47641
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: TV36442
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: YG59194
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: NZ89280
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ89280%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for NZ89280: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: DV86201
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV86201%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for DV86201: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: MR47105
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: CP63934
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP63934%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for CP63934: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: WA70865
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: ZB75356
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: SM49398
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM49398%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for SM49398: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: ND99251
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND99251%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for ND99251: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: RE64067
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: DE18860
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE18860%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for DE18860: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: BM48711
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: NH24051
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH24051%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for NH24051: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: LU93439
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU93439%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for LU93439: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: GC10643
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC10643%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for GC10643: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: HD89174
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: LL57465
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: SD35651
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: VJ26511
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ26511%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for VJ26511: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: UM38141
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM38141%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for UM38141: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: XE84016
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: LD34697
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD34697%27 HTTP/1.1" 200 None
2026-03-30 09:13:34 [auto1.it] INFO: Scrape type for LD34697: 0
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: NN91424
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: JP07987
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: ZM57231
2026-03-30 09:13:34 [auto1.it] INFO: Found listing with ID: KG93031
2026-03-30 09:13:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:38 [auto1.it] INFO: Channel: 24h | Page: 79 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: PK33610
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK33610%27 HTTP/1.1" 200 None
2026-03-30 09:13:38 [auto1.it] INFO: Scrape type for PK33610: 0
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: FL38609
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: PR73005
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR73005%27 HTTP/1.1" 200 None
2026-03-30 09:13:38 [auto1.it] INFO: Scrape type for PR73005: 0
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: VU45167
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU45167%27 HTTP/1.1" 200 None
2026-03-30 09:13:38 [auto1.it] INFO: Scrape type for VU45167: 0
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: YD14292
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD14292%27 HTTP/1.1" 200 None
2026-03-30 09:13:38 [auto1.it] INFO: Scrape type for YD14292: 0
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: HC79760
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC79760%27 HTTP/1.1" 200 None
2026-03-30 09:13:38 [auto1.it] INFO: Scrape type for HC79760: 0
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: YJ65230
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: AY38539
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY38539%27 HTTP/1.1" 200 None
2026-03-30 09:13:38 [auto1.it] INFO: Scrape type for AY38539: 0
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: FN08703
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN08703%27 HTTP/1.1" 200 None
2026-03-30 09:13:38 [auto1.it] INFO: Scrape type for FN08703: 0
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: DK59825
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: SN64311
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: WA74903
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74903%27 HTTP/1.1" 200 None
2026-03-30 09:13:38 [auto1.it] INFO: Scrape type for WA74903: 0
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: NV36405
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: RX99129
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX99129%27 HTTP/1.1" 200 None
2026-03-30 09:13:38 [auto1.it] INFO: Scrape type for RX99129: 0
2026-03-30 09:13:38 [auto1.it] INFO: Found listing with ID: EY62872
2026-03-30 09:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY62872%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for EY62872: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: MT10040
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: DE88474
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: FC40925
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: LB90809
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: EU57494
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU57494%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for EU57494: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: EG76959
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG76959%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for EG76959: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: EW38815
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW38815%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for EW38815: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: RC51898
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC51898%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for RC51898: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: RL93891
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: EX32240
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX32240%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for EX32240: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: SC52671
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: ZD86423
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD86423%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for ZD86423: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: FJ00600
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: GD51545
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD51545%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for GD51545: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: HC77212
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: UD61440
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD61440%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for UD61440: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: EP46313
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP46313%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for EP46313: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: NB70789
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB70789%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for NB70789: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: ZF56836
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: LS68308
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS68308%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for LS68308: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: LX14349
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: HU17700
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU17700%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for HU17700: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: XB86450
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: BC13106
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC13106%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for BC13106: 0
2026-03-30 09:13:39 [auto1.it] INFO: Found listing with ID: SS75136
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS75136%27 HTTP/1.1" 200 None
2026-03-30 09:13:39 [auto1.it] INFO: Scrape type for SS75136: 0
2026-03-30 09:13:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:40 [auto1.it] INFO: Channel: 24h | Page: 80 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: TZ08821
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: FW12151
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW12151%27 HTTP/1.1" 200 None
2026-03-30 09:13:40 [auto1.it] INFO: Scrape type for FW12151: 0
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: SD66994
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD66994%27 HTTP/1.1" 200 None
2026-03-30 09:13:40 [auto1.it] INFO: Scrape type for SD66994: 0
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: LB50046
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB50046%27 HTTP/1.1" 200 None
2026-03-30 09:13:40 [auto1.it] INFO: Scrape type for LB50046: 0
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: NL74097
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: ME27860
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: MX93098
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX93098%27 HTTP/1.1" 200 None
2026-03-30 09:13:40 [auto1.it] INFO: Scrape type for MX93098: 0
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: CL75380
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: VK29965
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK29965%27 HTTP/1.1" 200 None
2026-03-30 09:13:40 [auto1.it] INFO: Scrape type for VK29965: 0
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: WG00273
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG00273%27 HTTP/1.1" 200 None
2026-03-30 09:13:40 [auto1.it] INFO: Scrape type for WG00273: 0
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: BX84836
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: ZH45027
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: CD24058
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: VB56015
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB56015%27 HTTP/1.1" 200 None
2026-03-30 09:13:40 [auto1.it] INFO: Scrape type for VB56015: 0
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: TV81460
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: RK78436
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK78436%27 HTTP/1.1" 200 None
2026-03-30 09:13:40 [auto1.it] INFO: Scrape type for RK78436: 0
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: SX60727
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: SF25356
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: PB64949
2026-03-30 09:13:40 [auto1.it] INFO: Found listing with ID: HW36660
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW36660%27 HTTP/1.1" 200 None
2026-03-30 09:13:40 [auto1.it] INFO: Scrape type for HW36660: 2
2026-03-30 09:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with identifier: HW36660
2026-03-30 09:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with scrape type 2
2026-03-30 09:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with scrape type 2
2026-03-30 09:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2dd0c6c7-5039-595b-9212-3784bd7d10b5, identifier: HW36660
2026-03-30 09:13:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with identifier: HW36660
2026-03-30 09:13:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with identifier: HW36660
2026-03-30 09:13:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2dd0c6c7-5039-595b-9212-3784bd7d10b5 with identifier: HW36660 to the API
2026-03-30 09:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:33:29Z',
 'fuel_type': 'diesel',
 'id': '2dd0c6c7-5039-595b-9212-3784bd7d10b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW36660',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 221716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-30',
 'seller_name': None,
 'title': 'Lancia Delta 1.6 Diesel Oro',
 'transmission': 'automatic',
 'trim': 'Oro',
 'year': 2013}
2026-03-30 09:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW36660%27 HTTP/1.1" 200 None
2026-03-30 09:13:41 [auto1.it] INFO: Saving data for HW36660: {'auction_closing_time': 1774884809.0, 'created_time': 1774688765.683369, 'last_price_update_time': 1774862021.872027}
2026-03-30 09:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW36660') HTTP/1.1" 204 0
2026-03-30 09:13:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:41 [auto1.it] INFO: Found listing with ID: GX37056
2026-03-30 09:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX37056%27 HTTP/1.1" 200 None
2026-03-30 09:13:42 [auto1.it] INFO: Scrape type for GX37056: 2
2026-03-30 09:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 402cca32-ea88-5243-98dc-2e8998980a8f with identifier: GX37056
2026-03-30 09:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 402cca32-ea88-5243-98dc-2e8998980a8f with scrape type 2
2026-03-30 09:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 402cca32-ea88-5243-98dc-2e8998980a8f with scrape type 2
2026-03-30 09:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 402cca32-ea88-5243-98dc-2e8998980a8f, identifier: GX37056
2026-03-30 09:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 402cca32-ea88-5243-98dc-2e8998980a8f with identifier: GX37056
2026-03-30 09:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 402cca32-ea88-5243-98dc-2e8998980a8f with identifier: GX37056
2026-03-30 09:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 402cca32-ea88-5243-98dc-2e8998980a8f with identifier: GX37056 to the API
2026-03-30 09:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:00:07Z',
 'fuel_type': 'diesel',
 'id': '402cca32-ea88-5243-98dc-2e8998980a8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX37056',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 106692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'MINI Countryman Cooper SD',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 09:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX37056%27 HTTP/1.1" 200 None
2026-03-30 09:13:42 [auto1.it] INFO: Saving data for GX37056: {'auction_closing_time': 1774882807.0, 'created_time': 1774688752.851691, 'last_price_update_time': 1774862022.749622}
2026-03-30 09:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GX37056') HTTP/1.1" 204 0
2026-03-30 09:13:42 [auto1.it] INFO: Found listing with ID: HR61031
2026-03-30 09:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR61031%27 HTTP/1.1" 200 None
2026-03-30 09:13:42 [auto1.it] INFO: Scrape type for HR61031: 2
2026-03-30 09:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06fc907a-d0b0-59af-818a-07274779fdab with identifier: HR61031
2026-03-30 09:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06fc907a-d0b0-59af-818a-07274779fdab with scrape type 2
2026-03-30 09:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06fc907a-d0b0-59af-818a-07274779fdab with scrape type 2
2026-03-30 09:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 06fc907a-d0b0-59af-818a-07274779fdab, identifier: HR61031
2026-03-30 09:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 06fc907a-d0b0-59af-818a-07274779fdab with identifier: HR61031
2026-03-30 09:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 06fc907a-d0b0-59af-818a-07274779fdab with identifier: HR61031
2026-03-30 09:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 06fc907a-d0b0-59af-818a-07274779fdab with identifier: HR61031 to the API
2026-03-30 09:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:14:44Z',
 'fuel_type': 'diesel',
 'id': '06fc907a-d0b0-59af-818a-07274779fdab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR61031',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 36842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-20',
 'seller_name': None,
 'title': 'Fiat Panda 1.3 JTD Climbing 4x4',
 'transmission': 'manual',
 'trim': 'Climbing 4x4',
 'year': 2006}
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR61031%27 HTTP/1.1" 200 None
2026-03-30 09:13:43 [auto1.it] INFO: Saving data for HR61031: {'auction_closing_time': 1774883684.0, 'created_time': 1774688813.582243, 'last_price_update_time': 1774862023.256935}
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HR61031') HTTP/1.1" 204 0
2026-03-30 09:13:43 [auto1.it] INFO: Found listing with ID: RU00933
2026-03-30 09:13:43 [auto1.it] INFO: Found listing with ID: SP24974
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP24974%27 HTTP/1.1" 200 None
2026-03-30 09:13:43 [auto1.it] INFO: Scrape type for SP24974: 2
2026-03-30 09:13:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with identifier: SP24974
2026-03-30 09:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with scrape type 2
2026-03-30 09:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with scrape type 2
2026-03-30 09:13:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73, identifier: SP24974
2026-03-30 09:13:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with identifier: SP24974
2026-03-30 09:13:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with identifier: SP24974
2026-03-30 09:13:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 93f50bf2-fac4-5ee7-8ae1-78949ff3ee73 with identifier: SP24974 to the API
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:11:07Z',
 'fuel_type': 'petrol',
 'id': '93f50bf2-fac4-5ee7-8ae1-78949ff3ee73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP24974',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 135445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-28',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP24974%27 HTTP/1.1" 200 None
2026-03-30 09:13:43 [auto1.it] INFO: Saving data for SP24974: {'auction_closing_time': 1774883467.0, 'created_time': 1774688798.42674, 'last_price_update_time': 1774862023.65004}
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SP24974') HTTP/1.1" 204 0
2026-03-30 09:13:43 [auto1.it] INFO: Found listing with ID: WU48756
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU48756%27 HTTP/1.1" 200 None
2026-03-30 09:13:43 [auto1.it] INFO: Scrape type for WU48756: 2
2026-03-30 09:13:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27df52f4-daf0-5a30-bf3d-faa9dec0fa40 with identifier: WU48756
2026-03-30 09:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27df52f4-daf0-5a30-bf3d-faa9dec0fa40 with scrape type 2
2026-03-30 09:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27df52f4-daf0-5a30-bf3d-faa9dec0fa40 with scrape type 2
2026-03-30 09:13:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27df52f4-daf0-5a30-bf3d-faa9dec0fa40, identifier: WU48756
2026-03-30 09:13:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27df52f4-daf0-5a30-bf3d-faa9dec0fa40 with identifier: WU48756
2026-03-30 09:13:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27df52f4-daf0-5a30-bf3d-faa9dec0fa40 with identifier: WU48756
2026-03-30 09:13:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 27df52f4-daf0-5a30-bf3d-faa9dec0fa40 with identifier: WU48756 to the API
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:37:17Z',
 'fuel_type': 'diesel',
 'id': '27df52f4-daf0-5a30-bf3d-faa9dec0fa40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU48756',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 165240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2020}
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU48756%27 HTTP/1.1" 200 None
2026-03-30 09:13:44 [auto1.it] INFO: Saving data for WU48756: {'auction_closing_time': 1774885037.0, 'created_time': 1774688800.333907, 'last_price_update_time': 1774862024.031349}
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WU48756') HTTP/1.1" 204 0
2026-03-30 09:13:44 [auto1.it] INFO: Found listing with ID: PR17884
2026-03-30 09:13:44 [auto1.it] INFO: Found listing with ID: XP65023
2026-03-30 09:13:44 [auto1.it] INFO: Found listing with ID: FV28373
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV28373%27 HTTP/1.1" 200 None
2026-03-30 09:13:44 [auto1.it] INFO: Scrape type for FV28373: 2
2026-03-30 09:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171 with identifier: FV28373
2026-03-30 09:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171 with scrape type 2
2026-03-30 09:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171 with scrape type 2
2026-03-30 09:13:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171, identifier: FV28373
2026-03-30 09:13:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171 with identifier: FV28373
2026-03-30 09:13:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171 with identifier: FV28373
2026-03-30 09:13:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0ebd2e9e-5aea-50c8-8a28-c4b7b9316171 with identifier: FV28373 to the API
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:43Z',
 'fuel_type': 'petrol',
 'id': '0ebd2e9e-5aea-50c8-8a28-c4b7b9316171',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV28373',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 271786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-29',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2007}
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV28373%27 HTTP/1.1" 200 None
2026-03-30 09:13:44 [auto1.it] INFO: Saving data for FV28373: {'auction_closing_time': 1774884523.0, 'created_time': 1774688740.749906, 'last_price_update_time': 1774862024.431778}
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FV28373') HTTP/1.1" 204 0
2026-03-30 09:13:44 [auto1.it] INFO: Found listing with ID: BU89130
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU89130%27 HTTP/1.1" 200 None
2026-03-30 09:13:44 [auto1.it] INFO: Scrape type for BU89130: 2
2026-03-30 09:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3631ea6d-4553-5fb3-b183-983c0ed9560b with identifier: BU89130
2026-03-30 09:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3631ea6d-4553-5fb3-b183-983c0ed9560b with scrape type 2
2026-03-30 09:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3631ea6d-4553-5fb3-b183-983c0ed9560b with scrape type 2
2026-03-30 09:13:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3631ea6d-4553-5fb3-b183-983c0ed9560b, identifier: BU89130
2026-03-30 09:13:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3631ea6d-4553-5fb3-b183-983c0ed9560b with identifier: BU89130
2026-03-30 09:13:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3631ea6d-4553-5fb3-b183-983c0ed9560b with identifier: BU89130
2026-03-30 09:13:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3631ea6d-4553-5fb3-b183-983c0ed9560b with identifier: BU89130 to the API
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:19:50Z',
 'fuel_type': 'diesel',
 'id': '3631ea6d-4553-5fb3-b183-983c0ed9560b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU89130',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 168514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-14',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.8 CRD Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2011}
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU89130%27 HTTP/1.1" 200 None
2026-03-30 09:13:44 [auto1.it] INFO: Saving data for BU89130: {'auction_closing_time': 1774883990.0, 'created_time': 1774688763.168112, 'last_price_update_time': 1774862024.820888}
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BU89130') HTTP/1.1" 204 0
2026-03-30 09:13:44 [auto1.it] INFO: Found listing with ID: WM91137
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM91137%27 HTTP/1.1" 200 None
2026-03-30 09:13:44 [auto1.it] INFO: Scrape type for WM91137: 2
2026-03-30 09:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063a8e98-2d37-52d9-8db0-61c9688b6628 with identifier: WM91137
2026-03-30 09:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063a8e98-2d37-52d9-8db0-61c9688b6628 with scrape type 2
2026-03-30 09:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 063a8e98-2d37-52d9-8db0-61c9688b6628 with scrape type 2
2026-03-30 09:13:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 063a8e98-2d37-52d9-8db0-61c9688b6628, identifier: WM91137
2026-03-30 09:13:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 063a8e98-2d37-52d9-8db0-61c9688b6628 with identifier: WM91137
2026-03-30 09:13:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 063a8e98-2d37-52d9-8db0-61c9688b6628 with identifier: WM91137
2026-03-30 09:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 063a8e98-2d37-52d9-8db0-61c9688b6628 with identifier: WM91137 to the API
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:54:26Z',
 'fuel_type': 'diesel',
 'id': '063a8e98-2d37-52d9-8db0-61c9688b6628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM91137',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 231381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-07',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM91137%27 HTTP/1.1" 200 None
2026-03-30 09:13:45 [auto1.it] INFO: Saving data for WM91137: {'auction_closing_time': 1774886066.0, 'created_time': 1774688738.219023, 'last_price_update_time': 1774862025.253781}
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WM91137') HTTP/1.1" 204 0
2026-03-30 09:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:45 [auto1.it] INFO: Found listing with ID: JB83443
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB83443%27 HTTP/1.1" 200 None
2026-03-30 09:13:45 [auto1.it] INFO: Scrape type for JB83443: 2
2026-03-30 09:13:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ad9e16-76e0-5254-8d06-518ec655d30e with identifier: JB83443
2026-03-30 09:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ad9e16-76e0-5254-8d06-518ec655d30e with scrape type 2
2026-03-30 09:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5ad9e16-76e0-5254-8d06-518ec655d30e with scrape type 2
2026-03-30 09:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5ad9e16-76e0-5254-8d06-518ec655d30e, identifier: JB83443
2026-03-30 09:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5ad9e16-76e0-5254-8d06-518ec655d30e with identifier: JB83443
2026-03-30 09:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5ad9e16-76e0-5254-8d06-518ec655d30e with identifier: JB83443
2026-03-30 09:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5ad9e16-76e0-5254-8d06-518ec655d30e with identifier: JB83443 to the API
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:51:15Z',
 'fuel_type': 'diesel',
 'id': 'f5ad9e16-76e0-5254-8d06-518ec655d30e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB83443',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 187922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-22',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Technofeel',
 'transmission': 'manual',
 'trim': 'Technofeel',
 'year': 2014}
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB83443%27 HTTP/1.1" 200 None
2026-03-30 09:13:45 [auto1.it] INFO: Saving data for JB83443: {'auction_closing_time': 1774885875.0, 'created_time': 1774688758.887179, 'last_price_update_time': 1774862025.635646}
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JB83443') HTTP/1.1" 204 0
2026-03-30 09:13:45 [auto1.it] INFO: Found listing with ID: MR74044
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR74044%27 HTTP/1.1" 200 None
2026-03-30 09:13:45 [auto1.it] INFO: Scrape type for MR74044: 2
2026-03-30 09:13:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea23627-d31f-50e7-baf2-c1656e2b8f3d with identifier: MR74044
2026-03-30 09:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea23627-d31f-50e7-baf2-c1656e2b8f3d with scrape type 2
2026-03-30 09:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ea23627-d31f-50e7-baf2-c1656e2b8f3d with scrape type 2
2026-03-30 09:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ea23627-d31f-50e7-baf2-c1656e2b8f3d, identifier: MR74044
2026-03-30 09:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ea23627-d31f-50e7-baf2-c1656e2b8f3d with identifier: MR74044
2026-03-30 09:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ea23627-d31f-50e7-baf2-c1656e2b8f3d with identifier: MR74044
2026-03-30 09:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ea23627-d31f-50e7-baf2-c1656e2b8f3d with identifier: MR74044 to the API
2026-03-30 09:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:06:52Z',
 'fuel_type': 'diesel',
 'id': '8ea23627-d31f-50e7-baf2-c1656e2b8f3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR74044',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 392140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-28',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR74044%27 HTTP/1.1" 200 None
2026-03-30 09:13:46 [auto1.it] INFO: Saving data for MR74044: {'auction_closing_time': 1774883212.0, 'created_time': 1774688744.673526, 'last_price_update_time': 1774862026.251911}
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MR74044') HTTP/1.1" 204 0
2026-03-30 09:13:46 [auto1.it] INFO: Channel: 24h | Page: 81 | totalHits: 3315 | hits on page: 40
2026-03-30 09:13:46 [auto1.it] INFO: Found listing with ID: PB47164
2026-03-30 09:13:46 [auto1.it] INFO: Found listing with ID: RU74019
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU74019%27 HTTP/1.1" 200 None
2026-03-30 09:13:46 [auto1.it] INFO: Scrape type for RU74019: 2
2026-03-30 09:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with identifier: RU74019
2026-03-30 09:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with scrape type 2
2026-03-30 09:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with scrape type 2
2026-03-30 09:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb, identifier: RU74019
2026-03-30 09:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with identifier: RU74019
2026-03-30 09:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with identifier: RU74019
2026-03-30 09:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb with identifier: RU74019 to the API
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:16:58Z',
 'fuel_type': 'petrol',
 'id': '3c7ba322-90ac-5fce-ae45-8fd2a3aa84cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU74019',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 150498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-03',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Active Collection',
 'transmission': 'manual',
 'trim': 'Active Collection',
 'year': 2016}
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU74019%27 HTTP/1.1" 200 None
2026-03-30 09:13:46 [auto1.it] INFO: Saving data for RU74019: {'auction_closing_time': 1774883818.0, 'created_time': 1774688760.770734, 'last_price_update_time': 1774862026.671487}
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU74019') HTTP/1.1" 204 0
2026-03-30 09:13:46 [auto1.it] INFO: Found listing with ID: PR63683
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR63683%27 HTTP/1.1" 200 None
2026-03-30 09:13:46 [auto1.it] INFO: Scrape type for PR63683: 2
2026-03-30 09:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b48a4432-4359-50d0-9829-431557c92abe with identifier: PR63683
2026-03-30 09:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b48a4432-4359-50d0-9829-431557c92abe with scrape type 2
2026-03-30 09:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b48a4432-4359-50d0-9829-431557c92abe with scrape type 2
2026-03-30 09:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b48a4432-4359-50d0-9829-431557c92abe, identifier: PR63683
2026-03-30 09:13:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:46 [auto1.it] INFO: Found listing with ID: GT62268
2026-03-30 09:13:46 [auto1.it] INFO: Found listing with ID: NY06096
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY06096%27 HTTP/1.1" 200 None
2026-03-30 09:13:46 [auto1.it] INFO: Scrape type for NY06096: 2
2026-03-30 09:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a67c0962-2149-53ef-89ab-d2dd2dc55dea with identifier: NY06096
2026-03-30 09:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67c0962-2149-53ef-89ab-d2dd2dc55dea with scrape type 2
2026-03-30 09:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a67c0962-2149-53ef-89ab-d2dd2dc55dea with scrape type 2
2026-03-30 09:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a67c0962-2149-53ef-89ab-d2dd2dc55dea, identifier: NY06096
2026-03-30 09:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b48a4432-4359-50d0-9829-431557c92abe with identifier: PR63683
2026-03-30 09:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b48a4432-4359-50d0-9829-431557c92abe with identifier: PR63683
2026-03-30 09:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b48a4432-4359-50d0-9829-431557c92abe with identifier: PR63683 to the API
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:27:14Z',
 'fuel_type': 'petrol',
 'id': 'b48a4432-4359-50d0-9829-431557c92abe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR63683',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 111514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-28',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR63683%27 HTTP/1.1" 200 None
2026-03-30 09:13:47 [auto1.it] INFO: Saving data for PR63683: {'auction_closing_time': 1774884434.0, 'created_time': 1774688830.436714, 'last_price_update_time': 1774862027.187512}
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR63683') HTTP/1.1" 204 0
2026-03-30 09:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a67c0962-2149-53ef-89ab-d2dd2dc55dea with identifier: NY06096
2026-03-30 09:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a67c0962-2149-53ef-89ab-d2dd2dc55dea with identifier: NY06096
2026-03-30 09:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a67c0962-2149-53ef-89ab-d2dd2dc55dea with identifier: NY06096 to the API
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:48Z',
 'fuel_type': 'diesel',
 'id': 'a67c0962-2149-53ef-89ab-d2dd2dc55dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY06096',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 158079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-26',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2016}
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY06096%27 HTTP/1.1" 200 None
2026-03-30 09:13:47 [auto1.it] INFO: Saving data for NY06096: {'auction_closing_time': 1774884528.0, 'created_time': 1774688761.4965, 'last_price_update_time': 1774862027.486396}
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NY06096') HTTP/1.1" 204 0
2026-03-30 09:13:47 [auto1.it] INFO: Found listing with ID: KC74563
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC74563%27 HTTP/1.1" 200 None
2026-03-30 09:13:47 [auto1.it] INFO: Scrape type for KC74563: 2
2026-03-30 09:13:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2fa789e-d778-5c8f-ad71-1e20f2a899dc with identifier: KC74563
2026-03-30 09:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2fa789e-d778-5c8f-ad71-1e20f2a899dc with scrape type 2
2026-03-30 09:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2fa789e-d778-5c8f-ad71-1e20f2a899dc with scrape type 2
2026-03-30 09:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a2fa789e-d778-5c8f-ad71-1e20f2a899dc, identifier: KC74563
2026-03-30 09:13:47 [auto1.it] INFO: Found listing with ID: DD11193
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD11193%27 HTTP/1.1" 200 None
2026-03-30 09:13:47 [auto1.it] INFO: Scrape type for DD11193: 2
2026-03-30 09:13:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba7ed83d-5a68-53a2-9d12-f933046502c2 with identifier: DD11193
2026-03-30 09:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba7ed83d-5a68-53a2-9d12-f933046502c2 with scrape type 2
2026-03-30 09:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba7ed83d-5a68-53a2-9d12-f933046502c2 with scrape type 2
2026-03-30 09:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ba7ed83d-5a68-53a2-9d12-f933046502c2, identifier: DD11193
2026-03-30 09:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a2fa789e-d778-5c8f-ad71-1e20f2a899dc with identifier: KC74563
2026-03-30 09:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a2fa789e-d778-5c8f-ad71-1e20f2a899dc with identifier: KC74563
2026-03-30 09:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a2fa789e-d778-5c8f-ad71-1e20f2a899dc with identifier: KC74563 to the API
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:05:22Z',
 'fuel_type': 'diesel',
 'id': 'a2fa789e-d778-5c8f-ad71-1e20f2a899dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC74563',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 142655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-31',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.7 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2008}
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC74563%27 HTTP/1.1" 200 None
2026-03-30 09:13:47 [auto1.it] INFO: Saving data for KC74563: {'auction_closing_time': 1774883122.0, 'created_time': 1774688828.138102, 'last_price_update_time': 1774862027.971556}
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC74563') HTTP/1.1" 204 0
2026-03-30 09:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ba7ed83d-5a68-53a2-9d12-f933046502c2 with identifier: DD11193
2026-03-30 09:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ba7ed83d-5a68-53a2-9d12-f933046502c2 with identifier: DD11193
2026-03-30 09:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ba7ed83d-5a68-53a2-9d12-f933046502c2 with identifier: DD11193 to the API
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:04:16Z',
 'fuel_type': 'petrol',
 'id': 'ba7ed83d-5a68-53a2-9d12-f933046502c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD11193',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'iQ',
 'odometer': 46737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-22',
 'seller_name': None,
 'title': 'Toyota iQ 1.0 VVT-i Sol',
 'transmission': 'automatic',
 'trim': 'Sol',
 'year': 2014}
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD11193%27 HTTP/1.1" 200 None
2026-03-30 09:13:48 [auto1.it] INFO: Saving data for DD11193: {'auction_closing_time': 1774883056.0, 'created_time': 1774688762.488148, 'last_price_update_time': 1774862028.248185}
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DD11193') HTTP/1.1" 204 0
2026-03-30 09:13:48 [auto1.it] INFO: Found listing with ID: JD73354
2026-03-30 09:13:48 [auto1.it] INFO: Found listing with ID: MB22824
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB22824%27 HTTP/1.1" 200 None
2026-03-30 09:13:48 [auto1.it] INFO: Scrape type for MB22824: 2
2026-03-30 09:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8576450-9316-5576-a88a-8201fbf05cc8 with identifier: MB22824
2026-03-30 09:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8576450-9316-5576-a88a-8201fbf05cc8 with scrape type 2
2026-03-30 09:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8576450-9316-5576-a88a-8201fbf05cc8 with scrape type 2
2026-03-30 09:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e8576450-9316-5576-a88a-8201fbf05cc8, identifier: MB22824
2026-03-30 09:13:48 [auto1.it] INFO: Found listing with ID: TU55073
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU55073%27 HTTP/1.1" 200 None
2026-03-30 09:13:48 [auto1.it] INFO: Scrape type for TU55073: 2
2026-03-30 09:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1bcde52-4b02-5e6c-93e8-ace40d504d49 with identifier: TU55073
2026-03-30 09:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1bcde52-4b02-5e6c-93e8-ace40d504d49 with scrape type 2
2026-03-30 09:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1bcde52-4b02-5e6c-93e8-ace40d504d49 with scrape type 2
2026-03-30 09:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c1bcde52-4b02-5e6c-93e8-ace40d504d49, identifier: TU55073
2026-03-30 09:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e8576450-9316-5576-a88a-8201fbf05cc8 with identifier: MB22824
2026-03-30 09:13:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e8576450-9316-5576-a88a-8201fbf05cc8 with identifier: MB22824
2026-03-30 09:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e8576450-9316-5576-a88a-8201fbf05cc8 with identifier: MB22824 to the API
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:47:43Z',
 'fuel_type': 'diesel',
 'id': 'e8576450-9316-5576-a88a-8201fbf05cc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB22824',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 251504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-11',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2007}
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB22824%27 HTTP/1.1" 200 None
2026-03-30 09:13:48 [auto1.it] INFO: Saving data for MB22824: {'auction_closing_time': 1774885663.0, 'created_time': 1774688819.633603, 'last_price_update_time': 1774862028.744794}
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MB22824') HTTP/1.1" 204 0
2026-03-30 09:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c1bcde52-4b02-5e6c-93e8-ace40d504d49 with identifier: TU55073
2026-03-30 09:13:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c1bcde52-4b02-5e6c-93e8-ace40d504d49 with identifier: TU55073
2026-03-30 09:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c1bcde52-4b02-5e6c-93e8-ace40d504d49 with identifier: TU55073 to the API
2026-03-30 09:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:34:46Z',
 'fuel_type': 'diesel',
 'id': 'c1bcde52-4b02-5e6c-93e8-ace40d504d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU55073',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 97297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-26',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2019}
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU55073%27 HTTP/1.1" 200 None
2026-03-30 09:13:49 [auto1.it] INFO: Saving data for TU55073: {'auction_closing_time': 1774884886.0, 'created_time': 1774688757.750703, 'last_price_update_time': 1774862029.111483}
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU55073') HTTP/1.1" 204 0
2026-03-30 09:13:49 [auto1.it] INFO: Found listing with ID: NW35507
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW35507%27 HTTP/1.1" 200 None
2026-03-30 09:13:49 [auto1.it] INFO: Scrape type for NW35507: 2
2026-03-30 09:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19c3575-20ed-5a1e-a32e-504237c9db68 with identifier: NW35507
2026-03-30 09:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19c3575-20ed-5a1e-a32e-504237c9db68 with scrape type 2
2026-03-30 09:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19c3575-20ed-5a1e-a32e-504237c9db68 with scrape type 2
2026-03-30 09:13:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b19c3575-20ed-5a1e-a32e-504237c9db68, identifier: NW35507
2026-03-30 09:13:49 [auto1.it] INFO: Found listing with ID: JC52693
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC52693%27 HTTP/1.1" 200 None
2026-03-30 09:13:49 [auto1.it] INFO: Scrape type for JC52693: 2
2026-03-30 09:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with identifier: JC52693
2026-03-30 09:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with scrape type 2
2026-03-30 09:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with scrape type 2
2026-03-30 09:13:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c7aae4a-a871-5e31-92c9-5c95d73d67d2, identifier: JC52693
2026-03-30 09:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b19c3575-20ed-5a1e-a32e-504237c9db68 with identifier: NW35507
2026-03-30 09:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b19c3575-20ed-5a1e-a32e-504237c9db68 with identifier: NW35507
2026-03-30 09:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b19c3575-20ed-5a1e-a32e-504237c9db68 with identifier: NW35507 to the API
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-30T15:18:41Z',
 'fuel_type': 'petrol',
 'id': 'b19c3575-20ed-5a1e-a32e-504237c9db68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW35507',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 20282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-09',
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2024}
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW35507%27 HTTP/1.1" 200 None
2026-03-30 09:13:49 [auto1.it] INFO: Saving data for NW35507: {'auction_closing_time': 1774883921.0, 'created_time': 1774688820.546012, 'last_price_update_time': 1774862029.653051}
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NW35507') HTTP/1.1" 204 0
2026-03-30 09:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with identifier: JC52693
2026-03-30 09:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with identifier: JC52693
2026-03-30 09:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c7aae4a-a871-5e31-92c9-5c95d73d67d2 with identifier: JC52693 to the API
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:13:57Z',
 'fuel_type': 'diesel',
 'id': '3c7aae4a-a871-5e31-92c9-5c95d73d67d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC52693',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 122134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-21',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2020}
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC52693%27 HTTP/1.1" 200 None
2026-03-30 09:13:49 [auto1.it] INFO: Saving data for JC52693: {'auction_closing_time': 1774883637.0, 'created_time': 1774688758.489787, 'last_price_update_time': 1774862029.952684}
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC52693') HTTP/1.1" 204 0
2026-03-30 09:13:49 [auto1.it] INFO: Found listing with ID: AG64342
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG64342%27 HTTP/1.1" 200 None
2026-03-30 09:13:49 [auto1.it] INFO: Scrape type for AG64342: 2
2026-03-30 09:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e55afa9-7e7f-59a0-9331-bc794f9c9188 with identifier: AG64342
2026-03-30 09:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e55afa9-7e7f-59a0-9331-bc794f9c9188 with scrape type 2
2026-03-30 09:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e55afa9-7e7f-59a0-9331-bc794f9c9188 with scrape type 2
2026-03-30 09:13:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8e55afa9-7e7f-59a0-9331-bc794f9c9188, identifier: AG64342
2026-03-30 09:13:50 [auto1.it] INFO: Found listing with ID: BA37529
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA37529%27 HTTP/1.1" 200 None
2026-03-30 09:13:50 [auto1.it] INFO: Scrape type for BA37529: 2
2026-03-30 09:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3f20df5-0fe6-5c92-be21-c0209b8bce27 with identifier: BA37529
2026-03-30 09:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f20df5-0fe6-5c92-be21-c0209b8bce27 with scrape type 2
2026-03-30 09:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3f20df5-0fe6-5c92-be21-c0209b8bce27 with scrape type 2
2026-03-30 09:13:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c3f20df5-0fe6-5c92-be21-c0209b8bce27, identifier: BA37529
2026-03-30 09:13:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8e55afa9-7e7f-59a0-9331-bc794f9c9188 with identifier: AG64342
2026-03-30 09:13:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8e55afa9-7e7f-59a0-9331-bc794f9c9188 with identifier: AG64342
2026-03-30 09:13:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8e55afa9-7e7f-59a0-9331-bc794f9c9188 with identifier: AG64342 to the API
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:07:19Z',
 'fuel_type': 'diesel',
 'id': '8e55afa9-7e7f-59a0-9331-bc794f9c9188',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG64342',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 134730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-19',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG64342%27 HTTP/1.1" 200 None
2026-03-30 09:13:50 [auto1.it] INFO: Saving data for AG64342: {'auction_closing_time': 1774883239.0, 'created_time': 1774688808.006134, 'last_price_update_time': 1774862030.475001}
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AG64342') HTTP/1.1" 204 0
2026-03-30 09:13:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c3f20df5-0fe6-5c92-be21-c0209b8bce27 with identifier: BA37529
2026-03-30 09:13:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c3f20df5-0fe6-5c92-be21-c0209b8bce27 with identifier: BA37529
2026-03-30 09:13:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c3f20df5-0fe6-5c92-be21-c0209b8bce27 with identifier: BA37529 to the API
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:38Z',
 'fuel_type': 'diesel',
 'id': 'c3f20df5-0fe6-5c92-be21-c0209b8bce27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA37529',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 79875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA37529%27 HTTP/1.1" 200 None
2026-03-30 09:13:50 [auto1.it] INFO: Saving data for BA37529: {'auction_closing_time': 1774882838.0, 'created_time': 1774688835.70502, 'last_price_update_time': 1774862030.76711}
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BA37529') HTTP/1.1" 204 0
2026-03-30 09:13:50 [auto1.it] INFO: Found listing with ID: RC92896
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC92896%27 HTTP/1.1" 200 None
2026-03-30 09:13:50 [auto1.it] INFO: Scrape type for RC92896: 2
2026-03-30 09:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9a4e72a-932f-5374-8e55-5294198d9e4c with identifier: RC92896
2026-03-30 09:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9a4e72a-932f-5374-8e55-5294198d9e4c with scrape type 2
2026-03-30 09:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9a4e72a-932f-5374-8e55-5294198d9e4c with scrape type 2
2026-03-30 09:13:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e9a4e72a-932f-5374-8e55-5294198d9e4c, identifier: RC92896
2026-03-30 09:13:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e9a4e72a-932f-5374-8e55-5294198d9e4c with identifier: RC92896
2026-03-30 09:13:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e9a4e72a-932f-5374-8e55-5294198d9e4c with identifier: RC92896
2026-03-30 09:13:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e9a4e72a-932f-5374-8e55-5294198d9e4c with identifier: RC92896 to the API
2026-03-30 09:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:25:30Z',
 'fuel_type': 'diesel',
 'id': 'e9a4e72a-932f-5374-8e55-5294198d9e4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC92896',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 473793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 DRIVe R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2012}
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC92896%27 HTTP/1.1" 200 None
2026-03-30 09:13:51 [auto1.it] INFO: Saving data for RC92896: {'auction_closing_time': 1774884330.0, 'created_time': 1774688817.387607, 'last_price_update_time': 1774862031.166421}
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC92896') HTTP/1.1" 204 0
2026-03-30 09:13:51 [auto1.it] INFO: Found listing with ID: WK68121
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK68121%27 HTTP/1.1" 200 None
2026-03-30 09:13:51 [auto1.it] INFO: Scrape type for WK68121: 2
2026-03-30 09:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with identifier: WK68121
2026-03-30 09:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with scrape type 2
2026-03-30 09:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with scrape type 2
2026-03-30 09:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ebfb8d2-8b5e-51d5-a046-83091f641af8, identifier: WK68121
2026-03-30 09:13:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with identifier: WK68121
2026-03-30 09:13:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with identifier: WK68121
2026-03-30 09:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ebfb8d2-8b5e-51d5-a046-83091f641af8 with identifier: WK68121 to the API
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:47:43Z',
 'fuel_type': 'petrol',
 'id': '8ebfb8d2-8b5e-51d5-a046-83091f641af8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK68121',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 81885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK68121%27 HTTP/1.1" 200 None
2026-03-30 09:13:51 [auto1.it] INFO: Saving data for WK68121: {'auction_closing_time': 1774885663.0, 'created_time': 1774688822.045862, 'last_price_update_time': 1774862031.536608}
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WK68121') HTTP/1.1" 204 0
2026-03-30 09:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:13:51 [auto1.it] INFO: Found listing with ID: MM70792
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM70792%27 HTTP/1.1" 200 None
2026-03-30 09:13:51 [auto1.it] INFO: Scrape type for MM70792: 2
2026-03-30 09:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with identifier: MM70792
2026-03-30 09:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with scrape type 2
2026-03-30 09:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with scrape type 2
2026-03-30 09:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8, identifier: MM70792
2026-03-30 09:13:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with identifier: MM70792
2026-03-30 09:13:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with identifier: MM70792
2026-03-30 09:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8 with identifier: MM70792 to the API
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:56:58Z',
 'fuel_type': 'diesel',
 'id': 'a0e645d7-0e8a-5a8f-8b30-1ec394ddfee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM70792',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 183311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-31',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM70792%27 HTTP/1.1" 200 None
2026-03-30 09:13:51 [auto1.it] INFO: Saving data for MM70792: {'auction_closing_time': 1774886218.0, 'created_time': 1774688821.279384, 'last_price_update_time': 1774862031.922997}
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MM70792') HTTP/1.1" 204 0
2026-03-30 09:13:51 [auto1.it] INFO: Found listing with ID: RF74009
2026-03-30 09:13:51 [auto1.it] INFO: Found listing with ID: VP67579
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP67579%27 HTTP/1.1" 200 None
2026-03-30 09:13:51 [auto1.it] INFO: Scrape type for VP67579: 2
2026-03-30 09:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5 with identifier: VP67579
2026-03-30 09:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5 with scrape type 2
2026-03-30 09:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5 with scrape type 2
2026-03-30 09:13:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5, identifier: VP67579
2026-03-30 09:13:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5 with identifier: VP67579
2026-03-30 09:13:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5 with identifier: VP67579
2026-03-30 09:13:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5 with identifier: VP67579 to the API
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:45:46Z',
 'fuel_type': 'petrol',
 'id': '17f5254d-1d8b-57d5-9d74-a1f8cbe4c2b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP67579',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 112384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP67579%27 HTTP/1.1" 200 None
2026-03-30 09:13:52 [auto1.it] INFO: Saving data for VP67579: {'auction_closing_time': 1774885546.0, 'created_time': 1774688806.589235, 'last_price_update_time': 1774862032.323795}
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VP67579') HTTP/1.1" 204 0
2026-03-30 09:13:52 [auto1.it] INFO: Found listing with ID: FD11952
2026-03-30 09:13:52 [auto1.it] INFO: Found listing with ID: VM60926
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM60926%27 HTTP/1.1" 200 None
2026-03-30 09:13:52 [auto1.it] INFO: Scrape type for VM60926: 2
2026-03-30 09:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926
2026-03-30 09:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc81d046-8eab-513f-9931-4ce57eb14edb with scrape type 2
2026-03-30 09:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc81d046-8eab-513f-9931-4ce57eb14edb with scrape type 2
2026-03-30 09:13:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bc81d046-8eab-513f-9931-4ce57eb14edb, identifier: VM60926
2026-03-30 09:13:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926
2026-03-30 09:13:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926
2026-03-30 09:13:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926 to the API
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:17Z',
 'fuel_type': 'diesel',
 'id': 'bc81d046-8eab-513f-9931-4ce57eb14edb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM60926',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 196835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Advance BlueMotion',
 'transmission': 'automatic',
 'trim': 'Advance BlueMotion',
 'year': 2019}
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM60926%27 HTTP/1.1" 200 None
2026-03-30 09:13:52 [auto1.it] INFO: Saving data for VM60926: {'auction_closing_time': 1774885577.0, 'created_time': 1774688743.555664, 'last_price_update_time': 1774862032.700427}
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VM60926') HTTP/1.1" 204 0
2026-03-30 09:13:52 [auto1.it] INFO: Channel: 24h | Page: 82 | totalHits: 3314 | hits on page: 40
2026-03-30 09:13:52 [auto1.it] INFO: Found listing with ID: RY72509
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY72509%27 HTTP/1.1" 200 None
2026-03-30 09:13:52 [auto1.it] INFO: Scrape type for RY72509: 2
2026-03-30 09:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf2e031-95b6-5525-a5be-f8d5544a276c with identifier: RY72509
2026-03-30 09:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf2e031-95b6-5525-a5be-f8d5544a276c with scrape type 2
2026-03-30 09:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdf2e031-95b6-5525-a5be-f8d5544a276c with scrape type 2
2026-03-30 09:13:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bdf2e031-95b6-5525-a5be-f8d5544a276c, identifier: RY72509
2026-03-30 09:13:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bdf2e031-95b6-5525-a5be-f8d5544a276c with identifier: RY72509
2026-03-30 09:13:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bdf2e031-95b6-5525-a5be-f8d5544a276c with identifier: RY72509
2026-03-30 09:13:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bdf2e031-95b6-5525-a5be-f8d5544a276c with identifier: RY72509 to the API
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:15:42Z',
 'fuel_type': 'diesel',
 'id': 'bdf2e031-95b6-5525-a5be-f8d5544a276c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY72509',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 133242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-03',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY72509%27 HTTP/1.1" 200 None
2026-03-30 09:13:53 [auto1.it] INFO: Saving data for RY72509: {'auction_closing_time': 1774883742.0, 'created_time': 1774688749.895228, 'last_price_update_time': 1774862033.244387}
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RY72509') HTTP/1.1" 204 0
2026-03-30 09:13:53 [auto1.it] INFO: Found listing with ID: AL09653
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL09653%27 HTTP/1.1" 200 None
2026-03-30 09:13:53 [auto1.it] INFO: Scrape type for AL09653: 2
2026-03-30 09:13:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb851146-0294-5f7d-8d49-24c1d25e3f83 with identifier: AL09653
2026-03-30 09:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb851146-0294-5f7d-8d49-24c1d25e3f83 with scrape type 2
2026-03-30 09:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb851146-0294-5f7d-8d49-24c1d25e3f83 with scrape type 2
2026-03-30 09:13:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb851146-0294-5f7d-8d49-24c1d25e3f83, identifier: AL09653
2026-03-30 09:13:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:13:53 [auto1.it] INFO: Found listing with ID: UE94474
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE94474%27 HTTP/1.1" 200 None
2026-03-30 09:13:53 [auto1.it] INFO: Scrape type for UE94474: 2
2026-03-30 09:13:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 348d1838-f3b3-5602-b58c-d387a09af876 with identifier: UE94474
2026-03-30 09:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 348d1838-f3b3-5602-b58c-d387a09af876 with scrape type 2
2026-03-30 09:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 348d1838-f3b3-5602-b58c-d387a09af876 with scrape type 2
2026-03-30 09:13:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 348d1838-f3b3-5602-b58c-d387a09af876, identifier: UE94474
2026-03-30 09:13:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb851146-0294-5f7d-8d49-24c1d25e3f83 with identifier: AL09653
2026-03-30 09:13:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb851146-0294-5f7d-8d49-24c1d25e3f83 with identifier: AL09653
2026-03-30 09:13:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb851146-0294-5f7d-8d49-24c1d25e3f83 with identifier: AL09653 to the API
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:14:12Z',
 'fuel_type': 'petrol',
 'id': 'eb851146-0294-5f7d-8d49-24c1d25e3f83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL09653',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 13384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-30',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.0 Mild-Hybrid Gold',
 'transmission': 'manual',
 'trim': 'Gold',
 'year': 2022}
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL09653%27 HTTP/1.1" 200 None
2026-03-30 09:13:53 [auto1.it] INFO: Saving data for AL09653: {'auction_closing_time': 1774883652.0, 'created_time': 1773911129.227054, 'last_price_update_time': 1774862033.803589}
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL09653') HTTP/1.1" 204 0
2026-03-30 09:13:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 348d1838-f3b3-5602-b58c-d387a09af876 with identifier: UE94474
2026-03-30 09:13:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 348d1838-f3b3-5602-b58c-d387a09af876 with identifier: UE94474
2026-03-30 09:13:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 348d1838-f3b3-5602-b58c-d387a09af876 with identifier: UE94474 to the API
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:11:05Z',
 'fuel_type': 'diesel',
 'id': '348d1838-f3b3-5602-b58c-d387a09af876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE94474',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 195077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-12',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE94474%27 HTTP/1.1" 200 None
2026-03-30 09:13:54 [auto1.it] INFO: Saving data for UE94474: {'auction_closing_time': 1774883465.0, 'created_time': 1774688797.736942, 'last_price_update_time': 1774862034.105836}
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UE94474') HTTP/1.1" 204 0
2026-03-30 09:13:54 [auto1.it] INFO: Found listing with ID: DK55043
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK55043%27 HTTP/1.1" 200 None
2026-03-30 09:13:54 [auto1.it] INFO: Scrape type for DK55043: 2
2026-03-30 09:13:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e033872-a83b-5cff-98e9-c5694592bad3 with identifier: DK55043
2026-03-30 09:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e033872-a83b-5cff-98e9-c5694592bad3 with scrape type 2
2026-03-30 09:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e033872-a83b-5cff-98e9-c5694592bad3 with scrape type 2
2026-03-30 09:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e033872-a83b-5cff-98e9-c5694592bad3, identifier: DK55043
2026-03-30 09:13:54 [auto1.it] INFO: Found listing with ID: LG11591
2026-03-30 09:13:54 [auto1.it] INFO: Found listing with ID: UD99211
2026-03-30 09:13:54 [auto1.it] INFO: Found listing with ID: SX47374
2026-03-30 09:13:54 [auto1.it] INFO: Found listing with ID: AP90035
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP90035%27 HTTP/1.1" 200 None
2026-03-30 09:13:54 [auto1.it] INFO: Scrape type for AP90035: 2
2026-03-30 09:13:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8e3ceca-7eaa-5a05-bed5-5875453c8639 with identifier: AP90035
2026-03-30 09:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8e3ceca-7eaa-5a05-bed5-5875453c8639 with scrape type 2
2026-03-30 09:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8e3ceca-7eaa-5a05-bed5-5875453c8639 with scrape type 2
2026-03-30 09:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a8e3ceca-7eaa-5a05-bed5-5875453c8639, identifier: AP90035
2026-03-30 09:13:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e033872-a83b-5cff-98e9-c5694592bad3 with identifier: DK55043
2026-03-30 09:13:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e033872-a83b-5cff-98e9-c5694592bad3 with identifier: DK55043
2026-03-30 09:13:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e033872-a83b-5cff-98e9-c5694592bad3 with identifier: DK55043 to the API
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:31:45Z',
 'fuel_type': 'petrol',
 'id': '5e033872-a83b-5cff-98e9-c5694592bad3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK55043',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 269349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-28',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK55043%27 HTTP/1.1" 200 None
2026-03-30 09:13:54 [auto1.it] INFO: Saving data for DK55043: {'auction_closing_time': 1774884705.0, 'created_time': 1774688790.837686, 'last_price_update_time': 1774862034.6111}
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DK55043') HTTP/1.1" 204 0
2026-03-30 09:13:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a8e3ceca-7eaa-5a05-bed5-5875453c8639 with identifier: AP90035
2026-03-30 09:13:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a8e3ceca-7eaa-5a05-bed5-5875453c8639 with identifier: AP90035
2026-03-30 09:13:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a8e3ceca-7eaa-5a05-bed5-5875453c8639 with identifier: AP90035 to the API
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:25:39Z',
 'fuel_type': 'petrol',
 'id': 'a8e3ceca-7eaa-5a05-bed5-5875453c8639',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP90035',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 97132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-29',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2010}
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP90035%27 HTTP/1.1" 200 None
2026-03-30 09:13:54 [auto1.it] INFO: Saving data for AP90035: {'auction_closing_time': 1774884339.0, 'created_time': 1774688755.153839, 'last_price_update_time': 1774862034.889503}
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AP90035') HTTP/1.1" 204 0
2026-03-30 09:13:54 [auto1.it] INFO: Found listing with ID: AG82147
2026-03-30 09:13:54 [auto1.it] INFO: Found listing with ID: RG79014
2026-03-30 09:13:54 [auto1.it] INFO: Found listing with ID: NU26591
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU26591%27 HTTP/1.1" 200 None
2026-03-30 09:13:54 [auto1.it] INFO: Scrape type for NU26591: 2
2026-03-30 09:13:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95b064af-bfba-53a2-a199-97b5474b8605 with identifier: NU26591
2026-03-30 09:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95b064af-bfba-53a2-a199-97b5474b8605 with scrape type 2
2026-03-30 09:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95b064af-bfba-53a2-a199-97b5474b8605 with scrape type 2
2026-03-30 09:13:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95b064af-bfba-53a2-a199-97b5474b8605, identifier: NU26591
2026-03-30 09:13:55 [auto1.it] INFO: Found listing with ID: NS10029
2026-03-30 09:13:55 [auto1.it] INFO: Found listing with ID: BY89134
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY89134%27 HTTP/1.1" 200 None
2026-03-30 09:13:55 [auto1.it] INFO: Scrape type for BY89134: 2
2026-03-30 09:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc71848a-b641-55d6-a77a-76af8789aad2 with identifier: BY89134
2026-03-30 09:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc71848a-b641-55d6-a77a-76af8789aad2 with scrape type 2
2026-03-30 09:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc71848a-b641-55d6-a77a-76af8789aad2 with scrape type 2
2026-03-30 09:13:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc71848a-b641-55d6-a77a-76af8789aad2, identifier: BY89134
2026-03-30 09:13:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95b064af-bfba-53a2-a199-97b5474b8605 with identifier: NU26591
2026-03-30 09:13:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95b064af-bfba-53a2-a199-97b5474b8605 with identifier: NU26591
2026-03-30 09:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 95b064af-bfba-53a2-a199-97b5474b8605 with identifier: NU26591 to the API
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-30T15:47:01Z',
 'fuel_type': 'diesel',
 'id': '95b064af-bfba-53a2-a199-97b5474b8605',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU26591',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ8',
 'odometer': 214761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-10',
 'seller_name': None,
 'title': 'Audi SQ8 4.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU26591%27 HTTP/1.1" 200 None
2026-03-30 09:13:55 [auto1.it] INFO: Saving data for NU26591: {'auction_closing_time': 1774885621.0, 'created_time': 1774688769.675773, 'last_price_update_time': 1774862035.409304}
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NU26591') HTTP/1.1" 204 0
2026-03-30 09:13:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc71848a-b641-55d6-a77a-76af8789aad2 with identifier: BY89134
2026-03-30 09:13:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc71848a-b641-55d6-a77a-76af8789aad2 with identifier: BY89134
2026-03-30 09:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc71848a-b641-55d6-a77a-76af8789aad2 with identifier: BY89134 to the API
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:45:05Z',
 'fuel_type': 'petrol',
 'id': 'fc71848a-b641-55d6-a77a-76af8789aad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY89134',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 169114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-29',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY89134%27 HTTP/1.1" 200 None
2026-03-30 09:13:55 [auto1.it] INFO: Saving data for BY89134: {'auction_closing_time': 1774885505.0, 'created_time': 1774688756.415035, 'last_price_update_time': 1774862035.775469}
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BY89134') HTTP/1.1" 204 0
2026-03-30 09:13:55 [auto1.it] INFO: Found listing with ID: UB42424
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB42424%27 HTTP/1.1" 200 None
2026-03-30 09:13:55 [auto1.it] INFO: Scrape type for UB42424: 2
2026-03-30 09:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with identifier: UB42424
2026-03-30 09:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with scrape type 2
2026-03-30 09:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with scrape type 2
2026-03-30 09:13:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 52404a5c-b63a-54c1-90ea-fd713bf0ad09, identifier: UB42424
2026-03-30 09:13:55 [auto1.it] INFO: Found listing with ID: TW88152
2026-03-30 09:13:55 [auto1.it] INFO: Found listing with ID: MU21056
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU21056%27 HTTP/1.1" 200 None
2026-03-30 09:13:55 [auto1.it] INFO: Scrape type for MU21056: 2
2026-03-30 09:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64bdd1b-2b2c-560e-97c7-c114510cb31e with identifier: MU21056
2026-03-30 09:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64bdd1b-2b2c-560e-97c7-c114510cb31e with scrape type 2
2026-03-30 09:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64bdd1b-2b2c-560e-97c7-c114510cb31e with scrape type 2
2026-03-30 09:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e64bdd1b-2b2c-560e-97c7-c114510cb31e, identifier: MU21056
2026-03-30 09:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with identifier: UB42424
2026-03-30 09:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with identifier: UB42424
2026-03-30 09:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 52404a5c-b63a-54c1-90ea-fd713bf0ad09 with identifier: UB42424 to the API
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:06:29Z',
 'fuel_type': 'petrol',
 'id': '52404a5c-b63a-54c1-90ea-fd713bf0ad09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB42424',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 81135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Sport Edition',
 'transmission': 'manual',
 'trim': 'Sport Edition',
 'year': 2012}
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB42424%27 HTTP/1.1" 200 None
2026-03-30 09:13:56 [auto1.it] INFO: Saving data for UB42424: {'auction_closing_time': 1774883189.0, 'created_time': 1773130001.049804, 'last_price_update_time': 1774862036.273852}
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB42424') HTTP/1.1" 204 0
2026-03-30 09:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e64bdd1b-2b2c-560e-97c7-c114510cb31e with identifier: MU21056
2026-03-30 09:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e64bdd1b-2b2c-560e-97c7-c114510cb31e with identifier: MU21056
2026-03-30 09:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e64bdd1b-2b2c-560e-97c7-c114510cb31e with identifier: MU21056 to the API
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:47:35Z',
 'fuel_type': 'diesel',
 'id': 'e64bdd1b-2b2c-560e-97c7-c114510cb31e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU21056',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 130482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Opel Astra GTC 2.0 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2012}
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU21056%27 HTTP/1.1" 200 None
2026-03-30 09:13:56 [auto1.it] INFO: Saving data for MU21056: {'auction_closing_time': 1774885655.0, 'created_time': 1774688757.351073, 'last_price_update_time': 1774862036.55106}
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU21056') HTTP/1.1" 204 0
2026-03-30 09:13:56 [auto1.it] INFO: Found listing with ID: RV63380
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV63380%27 HTTP/1.1" 200 None
2026-03-30 09:13:56 [auto1.it] INFO: Scrape type for RV63380: 2
2026-03-30 09:13:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with identifier: RV63380
2026-03-30 09:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with scrape type 2
2026-03-30 09:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with scrape type 2
2026-03-30 09:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b6df7a9f-1dab-5409-a138-46e2ab4b07d4, identifier: RV63380
2026-03-30 09:13:56 [auto1.it] INFO: Found listing with ID: BG29864
2026-03-30 09:13:56 [auto1.it] INFO: Found listing with ID: XE56181
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE56181%27 HTTP/1.1" 200 None
2026-03-30 09:13:56 [auto1.it] INFO: Scrape type for XE56181: 2
2026-03-30 09:13:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with identifier: XE56181
2026-03-30 09:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with scrape type 2
2026-03-30 09:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with scrape type 2
2026-03-30 09:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cba2e24f-1a46-5d0c-ab57-e4a78668ed98, identifier: XE56181
2026-03-30 09:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with identifier: RV63380
2026-03-30 09:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with identifier: RV63380
2026-03-30 09:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b6df7a9f-1dab-5409-a138-46e2ab4b07d4 with identifier: RV63380 to the API
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:16:32Z',
 'fuel_type': 'petrol',
 'id': 'b6df7a9f-1dab-5409-a138-46e2ab4b07d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV63380',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 140593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-29',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Classique',
 'transmission': 'manual',
 'trim': 'Classique',
 'year': 2010}
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV63380%27 HTTP/1.1" 200 None
2026-03-30 09:13:57 [auto1.it] INFO: Saving data for RV63380: {'auction_closing_time': 1774883792.0, 'created_time': 1774688767.88537, 'last_price_update_time': 1774862037.071325}
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RV63380') HTTP/1.1" 204 0
2026-03-30 09:13:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with identifier: XE56181
2026-03-30 09:13:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with identifier: XE56181
2026-03-30 09:13:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cba2e24f-1a46-5d0c-ab57-e4a78668ed98 with identifier: XE56181 to the API
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:31:46Z',
 'fuel_type': 'petrol',
 'id': 'cba2e24f-1a46-5d0c-ab57-e4a78668ed98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE56181',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 86432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2017}
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE56181%27 HTTP/1.1" 200 None
2026-03-30 09:13:57 [auto1.it] INFO: Saving data for XE56181: {'auction_closing_time': 1774884706.0, 'created_time': 1774343240.185057, 'last_price_update_time': 1774862037.390643}
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XE56181') HTTP/1.1" 204 0
2026-03-30 09:13:57 [auto1.it] INFO: Found listing with ID: JE70672
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE70672%27 HTTP/1.1" 200 None
2026-03-30 09:13:57 [auto1.it] INFO: Scrape type for JE70672: 2
2026-03-30 09:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0201274d-d103-5b9f-b47f-a2350e121c7b with identifier: JE70672
2026-03-30 09:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0201274d-d103-5b9f-b47f-a2350e121c7b with scrape type 2
2026-03-30 09:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0201274d-d103-5b9f-b47f-a2350e121c7b with scrape type 2
2026-03-30 09:13:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0201274d-d103-5b9f-b47f-a2350e121c7b, identifier: JE70672
2026-03-30 09:13:57 [auto1.it] INFO: Found listing with ID: WY26414
2026-03-30 09:13:57 [auto1.it] INFO: Found listing with ID: CP34925
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP34925%27 HTTP/1.1" 200 None
2026-03-30 09:13:57 [auto1.it] INFO: Scrape type for CP34925: 2
2026-03-30 09:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e06c7891-bfc2-53b7-b745-fff38cff534e with identifier: CP34925
2026-03-30 09:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e06c7891-bfc2-53b7-b745-fff38cff534e with scrape type 2
2026-03-30 09:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e06c7891-bfc2-53b7-b745-fff38cff534e with scrape type 2
2026-03-30 09:13:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e06c7891-bfc2-53b7-b745-fff38cff534e, identifier: CP34925
2026-03-30 09:13:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0201274d-d103-5b9f-b47f-a2350e121c7b with identifier: JE70672
2026-03-30 09:13:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0201274d-d103-5b9f-b47f-a2350e121c7b with identifier: JE70672
2026-03-30 09:13:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0201274d-d103-5b9f-b47f-a2350e121c7b with identifier: JE70672 to the API
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:12:48Z',
 'fuel_type': 'diesel',
 'id': '0201274d-d103-5b9f-b47f-a2350e121c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE70672',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Executive BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Executive BlueMotion Tech',
 'year': 2016}
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE70672%27 HTTP/1.1" 200 None
2026-03-30 09:13:57 [auto1.it] INFO: Saving data for JE70672: {'auction_closing_time': 1774883568.0, 'created_time': 1774688795.659509, 'last_price_update_time': 1774862037.867575}
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE70672') HTTP/1.1" 204 0
2026-03-30 09:13:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e06c7891-bfc2-53b7-b745-fff38cff534e with identifier: CP34925
2026-03-30 09:13:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e06c7891-bfc2-53b7-b745-fff38cff534e with identifier: CP34925
2026-03-30 09:13:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e06c7891-bfc2-53b7-b745-fff38cff534e with identifier: CP34925 to the API
2026-03-30 09:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:24:49Z',
 'fuel_type': 'diesel',
 'id': 'e06c7891-bfc2-53b7-b745-fff38cff534e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP34925',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 206236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-25',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2018}
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP34925%27 HTTP/1.1" 200 None
2026-03-30 09:13:58 [auto1.it] INFO: Saving data for CP34925: {'auction_closing_time': 1774884289.0, 'created_time': 1774343247.091071, 'last_price_update_time': 1774862038.187039}
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CP34925') HTTP/1.1" 204 0
2026-03-30 09:13:58 [auto1.it] INFO: Found listing with ID: KL44785
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL44785%27 HTTP/1.1" 200 None
2026-03-30 09:13:58 [auto1.it] INFO: Scrape type for KL44785: 2
2026-03-30 09:13:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b425b7a-1a1e-5424-811c-d835384a92a0 with identifier: KL44785
2026-03-30 09:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b425b7a-1a1e-5424-811c-d835384a92a0 with scrape type 2
2026-03-30 09:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b425b7a-1a1e-5424-811c-d835384a92a0 with scrape type 2
2026-03-30 09:13:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b425b7a-1a1e-5424-811c-d835384a92a0, identifier: KL44785
2026-03-30 09:13:58 [auto1.it] INFO: Found listing with ID: UB84582
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB84582%27 HTTP/1.1" 200 None
2026-03-30 09:13:58 [auto1.it] INFO: Scrape type for UB84582: 2
2026-03-30 09:13:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c63c9504-634c-5e16-83a4-c48ec6ff5396 with identifier: UB84582
2026-03-30 09:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63c9504-634c-5e16-83a4-c48ec6ff5396 with scrape type 2
2026-03-30 09:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c63c9504-634c-5e16-83a4-c48ec6ff5396 with scrape type 2
2026-03-30 09:13:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c63c9504-634c-5e16-83a4-c48ec6ff5396, identifier: UB84582
2026-03-30 09:13:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b425b7a-1a1e-5424-811c-d835384a92a0 with identifier: KL44785
2026-03-30 09:13:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b425b7a-1a1e-5424-811c-d835384a92a0 with identifier: KL44785
2026-03-30 09:13:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b425b7a-1a1e-5424-811c-d835384a92a0 with identifier: KL44785 to the API
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:29:39Z',
 'fuel_type': 'diesel',
 'id': '7b425b7a-1a1e-5424-811c-d835384a92a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL44785',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 261183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM Panorama Family L2H1 130 Multijet',
 'transmission': 'manual',
 'trim': 'Panorama Family L2H1 130 Multijet',
 'year': 2012}
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL44785%27 HTTP/1.1" 200 None
2026-03-30 09:13:58 [auto1.it] INFO: Saving data for KL44785: {'auction_closing_time': 1774884579.0, 'created_time': 1774688754.772622, 'last_price_update_time': 1774862038.687406}
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KL44785') HTTP/1.1" 204 0
2026-03-30 09:13:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c63c9504-634c-5e16-83a4-c48ec6ff5396 with identifier: UB84582
2026-03-30 09:13:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c63c9504-634c-5e16-83a4-c48ec6ff5396 with identifier: UB84582
2026-03-30 09:13:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c63c9504-634c-5e16-83a4-c48ec6ff5396 with identifier: UB84582 to the API
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:42:00Z',
 'fuel_type': 'petrol',
 'id': 'c63c9504-634c-5e16-83a4-c48ec6ff5396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB84582',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 43968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-04',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2016}
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB84582%27 HTTP/1.1" 200 None
2026-03-30 09:13:59 [auto1.it] INFO: Saving data for UB84582: {'auction_closing_time': 1774885320.0, 'created_time': 1774688748.628153, 'last_price_update_time': 1774862039.059331}
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UB84582') HTTP/1.1" 204 0
2026-03-30 09:13:59 [auto1.it] INFO: Found listing with ID: TU59167
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59167%27 HTTP/1.1" 200 None
2026-03-30 09:13:59 [auto1.it] INFO: Scrape type for TU59167: 2
2026-03-30 09:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e9fe25c-0dbe-5298-99f6-7627c7332175 with identifier: TU59167
2026-03-30 09:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e9fe25c-0dbe-5298-99f6-7627c7332175 with scrape type 2
2026-03-30 09:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e9fe25c-0dbe-5298-99f6-7627c7332175 with scrape type 2
2026-03-30 09:13:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0e9fe25c-0dbe-5298-99f6-7627c7332175, identifier: TU59167
2026-03-30 09:13:59 [auto1.it] INFO: Found listing with ID: HY41860
2026-03-30 09:13:59 [auto1.it] INFO: Found listing with ID: CB28979
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB28979%27 HTTP/1.1" 200 None
2026-03-30 09:13:59 [auto1.it] INFO: Scrape type for CB28979: 2
2026-03-30 09:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with identifier: CB28979
2026-03-30 09:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with scrape type 2
2026-03-30 09:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with scrape type 2
2026-03-30 09:13:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b, identifier: CB28979
2026-03-30 09:13:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0e9fe25c-0dbe-5298-99f6-7627c7332175 with identifier: TU59167
2026-03-30 09:13:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0e9fe25c-0dbe-5298-99f6-7627c7332175 with identifier: TU59167
2026-03-30 09:13:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0e9fe25c-0dbe-5298-99f6-7627c7332175 with identifier: TU59167 to the API
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:48Z',
 'fuel_type': 'diesel',
 'id': '0e9fe25c-0dbe-5298-99f6-7627c7332175',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU59167',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 187406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-30',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59167%27 HTTP/1.1" 200 None
2026-03-30 09:13:59 [auto1.it] INFO: Saving data for TU59167: {'auction_closing_time': 1774885308.0, 'created_time': 1774688769.329015, 'last_price_update_time': 1774862039.555728}
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU59167') HTTP/1.1" 204 0
2026-03-30 09:13:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with identifier: CB28979
2026-03-30 09:13:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with identifier: CB28979
2026-03-30 09:13:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b with identifier: CB28979 to the API
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:13:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:59Z',
 'fuel_type': 'diesel',
 'id': '944fbf7b-d8a1-59f4-ba0f-79f2cabd3a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB28979',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 140125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-22',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Sound Edition ISG 2WD',
 'transmission': 'automatic',
 'trim': 'Sound Edition ISG 2WD',
 'year': 2018}
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB28979%27 HTTP/1.1" 200 None
2026-03-30 09:13:59 [auto1.it] INFO: Saving data for CB28979: {'auction_closing_time': 1774883519.0, 'created_time': 1774688792.803726, 'last_price_update_time': 1774862039.829141}
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CB28979') HTTP/1.1" 204 0
2026-03-30 09:13:59 [auto1.it] INFO: Found listing with ID: TD04886
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD04886%27 HTTP/1.1" 200 None
2026-03-30 09:13:59 [auto1.it] INFO: Scrape type for TD04886: 2
2026-03-30 09:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bc7c546-0122-5029-805b-39cc6c550770 with identifier: TD04886
2026-03-30 09:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc7c546-0122-5029-805b-39cc6c550770 with scrape type 2
2026-03-30 09:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bc7c546-0122-5029-805b-39cc6c550770 with scrape type 2
2026-03-30 09:13:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6bc7c546-0122-5029-805b-39cc6c550770, identifier: TD04886
2026-03-30 09:13:59 [auto1.it] INFO: Found listing with ID: FD69176
2026-03-30 09:13:59 [auto1.it] INFO: Found listing with ID: RG05236
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG05236%27 HTTP/1.1" 200 None
2026-03-30 09:13:59 [auto1.it] INFO: Scrape type for RG05236: 2
2026-03-30 09:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49c54439-704b-595e-9960-e714f6dd07ba with identifier: RG05236
2026-03-30 09:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c54439-704b-595e-9960-e714f6dd07ba with scrape type 2
2026-03-30 09:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49c54439-704b-595e-9960-e714f6dd07ba with scrape type 2
2026-03-30 09:14:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49c54439-704b-595e-9960-e714f6dd07ba, identifier: RG05236
2026-03-30 09:14:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6bc7c546-0122-5029-805b-39cc6c550770 with identifier: TD04886
2026-03-30 09:14:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6bc7c546-0122-5029-805b-39cc6c550770 with identifier: TD04886
2026-03-30 09:14:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6bc7c546-0122-5029-805b-39cc6c550770 with identifier: TD04886 to the API
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:41Z',
 'fuel_type': 'diesel',
 'id': '6bc7c546-0122-5029-805b-39cc6c550770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD04886',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 134839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-12',
 'seller_name': None,
 'title': 'BMW 1er 118d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2019}
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD04886%27 HTTP/1.1" 200 None
2026-03-30 09:14:00 [auto1.it] INFO: Saving data for TD04886: {'auction_closing_time': 1774883081.0, 'created_time': 1774688768.476944, 'last_price_update_time': 1774862040.556535}
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD04886') HTTP/1.1" 204 0
2026-03-30 09:14:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49c54439-704b-595e-9960-e714f6dd07ba with identifier: RG05236
2026-03-30 09:14:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49c54439-704b-595e-9960-e714f6dd07ba with identifier: RG05236
2026-03-30 09:14:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49c54439-704b-595e-9960-e714f6dd07ba with identifier: RG05236 to the API
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:36:43Z',
 'fuel_type': 'diesel',
 'id': '49c54439-704b-595e-9960-e714f6dd07ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG05236',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 223085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Societé',
 'transmission': 'manual',
 'trim': 'Societé',
 'year': 2016}
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG05236%27 HTTP/1.1" 200 None
2026-03-30 09:14:00 [auto1.it] INFO: Saving data for RG05236: {'auction_closing_time': 1774885003.0, 'created_time': 1774688777.07607, 'last_price_update_time': 1774862040.834573}
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG05236') HTTP/1.1" 204 0
2026-03-30 09:14:00 [auto1.it] INFO: Found listing with ID: NK26905
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK26905%27 HTTP/1.1" 200 None
2026-03-30 09:14:00 [auto1.it] INFO: Scrape type for NK26905: 2
2026-03-30 09:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with identifier: NK26905
2026-03-30 09:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with scrape type 2
2026-03-30 09:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with scrape type 2
2026-03-30 09:14:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7, identifier: NK26905
2026-03-30 09:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:14:00 [auto1.it] INFO: Found listing with ID: MN63848
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN63848%27 HTTP/1.1" 200 None
2026-03-30 09:14:00 [auto1.it] INFO: Scrape type for MN63848: 2
2026-03-30 09:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848
2026-03-30 09:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with scrape type 2
2026-03-30 09:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with scrape type 2
2026-03-30 09:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c, identifier: MN63848
2026-03-30 09:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with identifier: NK26905
2026-03-30 09:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with identifier: NK26905
2026-03-30 09:14:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7 with identifier: NK26905 to the API
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:18:18Z',
 'fuel_type': 'petrol',
 'id': '6bd54da9-bfb7-55ce-a6a4-41c7a7c805d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK26905',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 119046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-02',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Street',
 'transmission': 'manual',
 'trim': 'Street',
 'year': 2018}
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK26905%27 HTTP/1.1" 200 None
2026-03-30 09:14:01 [auto1.it] INFO: Saving data for NK26905: {'auction_closing_time': 1774883898.0, 'created_time': 1774688797.046401, 'last_price_update_time': 1774862041.393969}
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NK26905') HTTP/1.1" 204 0
2026-03-30 09:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848
2026-03-30 09:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848
2026-03-30 09:14:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848 to the API
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:50:06Z',
 'fuel_type': 'diesel',
 'id': '446c9d9f-984f-51fb-ad7a-b3fac5eea97c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN63848',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 196695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2017}
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN63848%27 HTTP/1.1" 200 None
2026-03-30 09:14:01 [auto1.it] INFO: Saving data for MN63848: {'auction_closing_time': 1774885806.0, 'created_time': 1774688794.979505, 'last_price_update_time': 1774862041.668606}
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MN63848') HTTP/1.1" 204 0
2026-03-30 09:14:01 [auto1.it] INFO: Found listing with ID: PL47981
2026-03-30 09:14:01 [auto1.it] INFO: Found listing with ID: EP64063
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP64063%27 HTTP/1.1" 200 None
2026-03-30 09:14:01 [auto1.it] INFO: Scrape type for EP64063: 2
2026-03-30 09:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with identifier: EP64063
2026-03-30 09:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with scrape type 2
2026-03-30 09:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with scrape type 2
2026-03-30 09:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 14331b05-cd5a-51a8-9a6a-0bda0a5c3056, identifier: EP64063
2026-03-30 09:14:01 [auto1.it] INFO: Found listing with ID: GC15950
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC15950%27 HTTP/1.1" 200 None
2026-03-30 09:14:01 [auto1.it] INFO: Scrape type for GC15950: 2
2026-03-30 09:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dedb6cc-43e3-5afe-b2ad-748f3461719e with identifier: GC15950
2026-03-30 09:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e with scrape type 2
2026-03-30 09:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dedb6cc-43e3-5afe-b2ad-748f3461719e with scrape type 2
2026-03-30 09:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9dedb6cc-43e3-5afe-b2ad-748f3461719e, identifier: GC15950
2026-03-30 09:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with identifier: EP64063
2026-03-30 09:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with identifier: EP64063
2026-03-30 09:14:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 14331b05-cd5a-51a8-9a6a-0bda0a5c3056 with identifier: EP64063 to the API
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:40:09Z',
 'fuel_type': 'petrol',
 'id': '14331b05-cd5a-51a8-9a6a-0bda0a5c3056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP64063',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 69963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-29',
 'seller_name': None,
 'title': 'Honda Jazz 1.3 i-VTEC Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2020}
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP64063%27 HTTP/1.1" 200 None
2026-03-30 09:14:02 [auto1.it] INFO: Saving data for EP64063: {'auction_closing_time': 1774885209.0, 'created_time': 1774688792.402249, 'last_price_update_time': 1774862042.215612}
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EP64063') HTTP/1.1" 204 0
2026-03-30 09:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9dedb6cc-43e3-5afe-b2ad-748f3461719e with identifier: GC15950
2026-03-30 09:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9dedb6cc-43e3-5afe-b2ad-748f3461719e with identifier: GC15950
2026-03-30 09:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9dedb6cc-43e3-5afe-b2ad-748f3461719e with identifier: GC15950 to the API
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:37Z',
 'fuel_type': 'diesel',
 'id': '9dedb6cc-43e3-5afe-b2ad-748f3461719e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC15950',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 99341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seller_name': None,
 'title': 'Audi A5 Sportback 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC15950%27 HTTP/1.1" 200 None
2026-03-30 09:14:02 [auto1.it] INFO: Saving data for GC15950: {'auction_closing_time': 1774885237.0, 'created_time': 1774688780.387165, 'last_price_update_time': 1774862042.594501}
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC15950') HTTP/1.1" 204 0
2026-03-30 09:14:02 [auto1.it] INFO: Found listing with ID: XS31843
2026-03-30 09:14:02 [auto1.it] INFO: Found listing with ID: DP98022
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP98022%27 HTTP/1.1" 200 None
2026-03-30 09:14:02 [auto1.it] INFO: Scrape type for DP98022: 2
2026-03-30 09:14:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 363e61f7-4252-5bf0-a1b2-0d180a176ffb with identifier: DP98022
2026-03-30 09:14:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 363e61f7-4252-5bf0-a1b2-0d180a176ffb with scrape type 2
2026-03-30 09:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 363e61f7-4252-5bf0-a1b2-0d180a176ffb with scrape type 2
2026-03-30 09:14:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 363e61f7-4252-5bf0-a1b2-0d180a176ffb, identifier: DP98022
2026-03-30 09:14:02 [auto1.it] INFO: Channel: 24h | Page: 83 | totalHits: 3314 | hits on page: 34
2026-03-30 09:14:02 [auto1.it] INFO: Found listing with ID: ZU87038
2026-03-30 09:14:02 [auto1.it] INFO: Found listing with ID: YR71782
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR71782%27 HTTP/1.1" 200 None
2026-03-30 09:14:02 [auto1.it] INFO: Scrape type for YR71782: 2
2026-03-30 09:14:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3022335d-6f84-581b-b193-8873e4bbb075 with identifier: YR71782
2026-03-30 09:14:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3022335d-6f84-581b-b193-8873e4bbb075 with scrape type 2
2026-03-30 09:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3022335d-6f84-581b-b193-8873e4bbb075 with scrape type 2
2026-03-30 09:14:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3022335d-6f84-581b-b193-8873e4bbb075, identifier: YR71782
2026-03-30 09:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 363e61f7-4252-5bf0-a1b2-0d180a176ffb with identifier: DP98022
2026-03-30 09:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 363e61f7-4252-5bf0-a1b2-0d180a176ffb with identifier: DP98022
2026-03-30 09:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 363e61f7-4252-5bf0-a1b2-0d180a176ffb with identifier: DP98022 to the API
2026-03-30 09:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:18:10Z',
 'fuel_type': 'diesel',
 'id': '363e61f7-4252-5bf0-a1b2-0d180a176ffb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP98022',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Antara',
 'odometer': 176271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-14',
 'seller_name': None,
 'title': 'Opel Antara 2.0 CDTI Cosmo 4x4',
 'transmission': 'automatic',
 'trim': 'Cosmo 4x4',
 'year': 2009}
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP98022%27 HTTP/1.1" 200 None
2026-03-30 09:14:03 [auto1.it] INFO: Saving data for DP98022: {'auction_closing_time': 1774883890.0, 'created_time': 1774688778.048225, 'last_price_update_time': 1774862043.112541}
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP98022') HTTP/1.1" 204 0
2026-03-30 09:14:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3022335d-6f84-581b-b193-8873e4bbb075 with identifier: YR71782
2026-03-30 09:14:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3022335d-6f84-581b-b193-8873e4bbb075 with identifier: YR71782
2026-03-30 09:14:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3022335d-6f84-581b-b193-8873e4bbb075 with identifier: YR71782 to the API
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:46:42Z',
 'fuel_type': 'petrol',
 'id': '3022335d-6f84-581b-b193-8873e4bbb075',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR71782',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 258470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-18',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR71782%27 HTTP/1.1" 200 None
2026-03-30 09:14:03 [auto1.it] INFO: Saving data for YR71782: {'auction_closing_time': 1774885602.0, 'created_time': 1774688794.269569, 'last_price_update_time': 1774862043.405972}
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YR71782') HTTP/1.1" 204 0
2026-03-30 09:14:03 [auto1.it] INFO: Found listing with ID: TZ57511
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ57511%27 HTTP/1.1" 200 None
2026-03-30 09:14:03 [auto1.it] INFO: Scrape type for TZ57511: 2
2026-03-30 09:14:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6488b779-3c9a-5a52-b6b9-f456660da4e0 with identifier: TZ57511
2026-03-30 09:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6488b779-3c9a-5a52-b6b9-f456660da4e0 with scrape type 2
2026-03-30 09:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6488b779-3c9a-5a52-b6b9-f456660da4e0 with scrape type 2
2026-03-30 09:14:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6488b779-3c9a-5a52-b6b9-f456660da4e0, identifier: TZ57511
2026-03-30 09:14:03 [auto1.it] INFO: Found listing with ID: WJ93918
2026-03-30 09:14:03 [auto1.it] INFO: Found listing with ID: PW21371
2026-03-30 09:14:03 [auto1.it] INFO: Found listing with ID: TR54078
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR54078%27 HTTP/1.1" 200 None
2026-03-30 09:14:03 [auto1.it] INFO: Scrape type for TR54078: 2
2026-03-30 09:14:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74849f8d-da12-56ab-abe2-9e9955a6aed6 with identifier: TR54078
2026-03-30 09:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74849f8d-da12-56ab-abe2-9e9955a6aed6 with scrape type 2
2026-03-30 09:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74849f8d-da12-56ab-abe2-9e9955a6aed6 with scrape type 2
2026-03-30 09:14:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 74849f8d-da12-56ab-abe2-9e9955a6aed6, identifier: TR54078
2026-03-30 09:14:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 09:14:03 [auto1.it] INFO: Found listing with ID: RX70685
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX70685%27 HTTP/1.1" 200 None
2026-03-30 09:14:03 [auto1.it] INFO: Scrape type for RX70685: 2
2026-03-30 09:14:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdbf227c-bd50-5928-800a-c959a597da67 with identifier: RX70685
2026-03-30 09:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdbf227c-bd50-5928-800a-c959a597da67 with scrape type 2
2026-03-30 09:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdbf227c-bd50-5928-800a-c959a597da67 with scrape type 2
2026-03-30 09:14:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fdbf227c-bd50-5928-800a-c959a597da67, identifier: RX70685
2026-03-30 09:14:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6488b779-3c9a-5a52-b6b9-f456660da4e0 with identifier: TZ57511
2026-03-30 09:14:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6488b779-3c9a-5a52-b6b9-f456660da4e0 with identifier: TZ57511
2026-03-30 09:14:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6488b779-3c9a-5a52-b6b9-f456660da4e0 with identifier: TZ57511 to the API
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:59:02Z',
 'fuel_type': 'diesel',
 'id': '6488b779-3c9a-5a52-b6b9-f456660da4e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ57511',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 145018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-10',
 'seller_name': None,
 'title': 'Jeep Compass 2.2 CRD Sport 4x2',
 'transmission': 'manual',
 'trim': 'Sport 4x2',
 'year': 2012}
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ57511%27 HTTP/1.1" 200 None
2026-03-30 09:14:04 [auto1.it] INFO: Saving data for TZ57511: {'auction_closing_time': 1774886342.0, 'created_time': 1774343139.889664, 'last_price_update_time': 1774862044.075494}
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ57511') HTTP/1.1" 204 0
2026-03-30 09:14:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 74849f8d-da12-56ab-abe2-9e9955a6aed6 with identifier: TR54078
2026-03-30 09:14:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 74849f8d-da12-56ab-abe2-9e9955a6aed6 with identifier: TR54078
2026-03-30 09:14:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 74849f8d-da12-56ab-abe2-9e9955a6aed6 with identifier: TR54078 to the API
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:50:48Z',
 'fuel_type': 'petrol',
 'id': '74849f8d-da12-56ab-abe2-9e9955a6aed6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR54078',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 203784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-27',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR54078%27 HTTP/1.1" 200 None
2026-03-30 09:14:04 [auto1.it] INFO: Saving data for TR54078: {'auction_closing_time': 1774885848.0, 'created_time': 1774688791.586156, 'last_price_update_time': 1774862044.361578}
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TR54078') HTTP/1.1" 204 0
2026-03-30 09:14:04 [scrapy.extensions.logstats] INFO: Crawled 335 pages (at 22 pages/min), scraped 622 items (at 55 items/min)
2026-03-30 09:14:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-30 09:14:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fdbf227c-bd50-5928-800a-c959a597da67 with identifier: RX70685
2026-03-30 09:14:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fdbf227c-bd50-5928-800a-c959a597da67 with identifier: RX70685
2026-03-30 09:14:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fdbf227c-bd50-5928-800a-c959a597da67 with identifier: RX70685 to the API
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:37:25Z',
 'fuel_type': 'petrol',
 'id': 'fdbf227c-bd50-5928-800a-c959a597da67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX70685',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 173164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX70685%27 HTTP/1.1" 200 None
2026-03-30 09:14:04 [auto1.it] INFO: Saving data for RX70685: {'auction_closing_time': 1774885045.0, 'created_time': 1774688784.909646, 'last_price_update_time': 1774862044.660306}
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX70685') HTTP/1.1" 204 0
2026-03-30 09:14:04 [auto1.it] INFO: Found listing with ID: XF75286
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF75286%27 HTTP/1.1" 200 None
2026-03-30 09:14:04 [auto1.it] INFO: Scrape type for XF75286: 2
2026-03-30 09:14:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with identifier: XF75286
2026-03-30 09:14:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with scrape type 2
2026-03-30 09:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with scrape type 2
2026-03-30 09:14:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b, identifier: XF75286
2026-03-30 09:14:04 [auto1.it] INFO: Found listing with ID: LG70821
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG70821%27 HTTP/1.1" 200 None
2026-03-30 09:14:04 [auto1.it] INFO: Scrape type for LG70821: 2
2026-03-30 09:14:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with identifier: LG70821
2026-03-30 09:14:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with scrape type 2
2026-03-30 09:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with scrape type 2
2026-03-30 09:14:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b1fa12d-e7ae-5664-8ceb-85f120eb9758, identifier: LG70821
2026-03-30 09:14:04 [auto1.it] INFO: Found listing with ID: ZG33148
2026-03-30 09:14:04 [auto1.it] INFO: Found listing with ID: JP42061
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP42061%27 HTTP/1.1" 200 None
2026-03-30 09:14:04 [auto1.it] INFO: Scrape type for JP42061: 2
2026-03-30 09:14:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f0d7d43-eb16-587c-9878-67034ac709a3 with identifier: JP42061
2026-03-30 09:14:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f0d7d43-eb16-587c-9878-67034ac709a3 with scrape type 2
2026-03-30 09:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f0d7d43-eb16-587c-9878-67034ac709a3 with scrape type 2
2026-03-30 09:14:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f0d7d43-eb16-587c-9878-67034ac709a3, identifier: JP42061
2026-03-30 09:14:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with identifier: XF75286
2026-03-30 09:14:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with identifier: XF75286
2026-03-30 09:14:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 16b65cd5-acdf-5d0b-8741-13bc0ab20a7b with identifier: XF75286 to the API
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:25:20Z',
 'fuel_type': 'diesel',
 'id': '16b65cd5-acdf-5d0b-8741-13bc0ab20a7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF75286',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat Alltrack',
 'odometer': 174415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-27',
 'seller_name': None,
 'title': 'Volkswagen Passat Alltrack 2.0 TDI 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion Tech',
 'year': 2018}
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF75286%27 HTTP/1.1" 200 None
2026-03-30 09:14:05 [auto1.it] INFO: Saving data for XF75286: {'auction_closing_time': 1774884320.0, 'created_time': 1774447596.014384, 'last_price_update_time': 1774862045.303649}
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XF75286') HTTP/1.1" 204 0
2026-03-30 09:14:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with identifier: LG70821
2026-03-30 09:14:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with identifier: LG70821
2026-03-30 09:14:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b1fa12d-e7ae-5664-8ceb-85f120eb9758 with identifier: LG70821 to the API
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:46:08Z',
 'fuel_type': 'diesel',
 'id': '1b1fa12d-e7ae-5664-8ceb-85f120eb9758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG70821',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 127639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-25',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Brave² 4x2',
 'transmission': 'manual',
 'trim': 'Brave² 4x2',
 'year': 2018}
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG70821%27 HTTP/1.1" 200 None
2026-03-30 09:14:05 [auto1.it] INFO: Saving data for LG70821: {'auction_closing_time': 1774885568.0, 'created_time': 1774688799.328714, 'last_price_update_time': 1774862045.663931}
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG70821') HTTP/1.1" 204 0
2026-03-30 09:14:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f0d7d43-eb16-587c-9878-67034ac709a3 with identifier: JP42061
2026-03-30 09:14:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f0d7d43-eb16-587c-9878-67034ac709a3 with identifier: JP42061
2026-03-30 09:14:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f0d7d43-eb16-587c-9878-67034ac709a3 with identifier: JP42061 to the API
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:46:39Z',
 'fuel_type': 'diesel',
 'id': '4f0d7d43-eb16-587c-9878-67034ac709a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP42061',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 41268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP42061%27 HTTP/1.1" 200 None
2026-03-30 09:14:05 [auto1.it] INFO: Saving data for JP42061: {'auction_closing_time': 1774885599.0, 'created_time': 1774343222.028961, 'last_price_update_time': 1774862045.949178}
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP42061') HTTP/1.1" 204 0
2026-03-30 09:14:05 [auto1.it] INFO: Found listing with ID: MN96094
2026-03-30 09:14:05 [auto1.it] INFO: Found listing with ID: YD21144
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD21144%27 HTTP/1.1" 200 None
2026-03-30 09:14:05 [auto1.it] INFO: Scrape type for YD21144: 2
2026-03-30 09:14:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5aab5b-d54b-5932-92d3-70e5eefa8263 with identifier: YD21144
2026-03-30 09:14:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5aab5b-d54b-5932-92d3-70e5eefa8263 with scrape type 2
2026-03-30 09:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5aab5b-d54b-5932-92d3-70e5eefa8263 with scrape type 2
2026-03-30 09:14:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf5aab5b-d54b-5932-92d3-70e5eefa8263, identifier: YD21144
2026-03-30 09:14:06 [auto1.it] INFO: Found listing with ID: TL02972
2026-03-30 09:14:06 [auto1.it] INFO: Found listing with ID: PD30072
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD30072%27 HTTP/1.1" 200 None
2026-03-30 09:14:06 [auto1.it] INFO: Scrape type for PD30072: 2
2026-03-30 09:14:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 867f7bec-ab0d-5cac-9780-7aeddac0960f with identifier: PD30072
2026-03-30 09:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 867f7bec-ab0d-5cac-9780-7aeddac0960f with scrape type 2
2026-03-30 09:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 867f7bec-ab0d-5cac-9780-7aeddac0960f with scrape type 2
2026-03-30 09:14:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 867f7bec-ab0d-5cac-9780-7aeddac0960f, identifier: PD30072
2026-03-30 09:14:06 [auto1.it] INFO: Found listing with ID: PR59695
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR59695%27 HTTP/1.1" 200 None
2026-03-30 09:14:06 [auto1.it] INFO: Scrape type for PR59695: 2
2026-03-30 09:14:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with identifier: PR59695
2026-03-30 09:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with scrape type 2
2026-03-30 09:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with scrape type 2
2026-03-30 09:14:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1ca1147e-c98b-50aa-a8a4-ce0ec137be32, identifier: PR59695
2026-03-30 09:14:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf5aab5b-d54b-5932-92d3-70e5eefa8263 with identifier: YD21144
2026-03-30 09:14:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf5aab5b-d54b-5932-92d3-70e5eefa8263 with identifier: YD21144
2026-03-30 09:14:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf5aab5b-d54b-5932-92d3-70e5eefa8263 with identifier: YD21144 to the API
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:39:15Z',
 'fuel_type': 'diesel',
 'id': 'bf5aab5b-d54b-5932-92d3-70e5eefa8263',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD21144',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 155349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-23',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD21144%27 HTTP/1.1" 200 None
2026-03-30 09:14:06 [auto1.it] INFO: Saving data for YD21144: {'auction_closing_time': 1774885155.0, 'created_time': 1773130267.263325, 'last_price_update_time': 1774862046.658404}
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD21144') HTTP/1.1" 204 0
2026-03-30 09:14:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 867f7bec-ab0d-5cac-9780-7aeddac0960f with identifier: PD30072
2026-03-30 09:14:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 867f7bec-ab0d-5cac-9780-7aeddac0960f with identifier: PD30072
2026-03-30 09:14:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 867f7bec-ab0d-5cac-9780-7aeddac0960f with identifier: PD30072 to the API
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:21:44Z',
 'fuel_type': 'petrol',
 'id': '867f7bec-ab0d-5cac-9780-7aeddac0960f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD30072',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 85517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-16',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD30072%27 HTTP/1.1" 200 None
2026-03-30 09:14:06 [auto1.it] INFO: Saving data for PD30072: {'auction_closing_time': 1774884104.0, 'created_time': 1774688810.536515, 'last_price_update_time': 1774862046.952128}
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PD30072') HTTP/1.1" 204 0
2026-03-30 09:14:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with identifier: PR59695
2026-03-30 09:14:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with identifier: PR59695
2026-03-30 09:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1ca1147e-c98b-50aa-a8a4-ce0ec137be32 with identifier: PR59695 to the API
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:39:35Z',
 'fuel_type': 'diesel',
 'id': '1ca1147e-c98b-50aa-a8a4-ce0ec137be32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR59695',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 293356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-04',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR59695%27 HTTP/1.1" 200 None
2026-03-30 09:14:07 [auto1.it] INFO: Saving data for PR59695: {'auction_closing_time': 1774885175.0, 'created_time': 1773135199.707348, 'last_price_update_time': 1774862047.243169}
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR59695') HTTP/1.1" 204 0
2026-03-30 09:14:07 [auto1.it] INFO: Found listing with ID: RT57270
2026-03-30 09:14:07 [auto1.it] INFO: Found listing with ID: JC99655
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC99655%27 HTTP/1.1" 200 None
2026-03-30 09:14:07 [auto1.it] INFO: Scrape type for JC99655: 2
2026-03-30 09:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59152a20-03e5-5c53-8083-4eb282cea514 with identifier: JC99655
2026-03-30 09:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59152a20-03e5-5c53-8083-4eb282cea514 with scrape type 2
2026-03-30 09:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59152a20-03e5-5c53-8083-4eb282cea514 with scrape type 2
2026-03-30 09:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 59152a20-03e5-5c53-8083-4eb282cea514, identifier: JC99655
2026-03-30 09:14:07 [auto1.it] INFO: Found listing with ID: PN93360
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN93360%27 HTTP/1.1" 200 None
2026-03-30 09:14:07 [auto1.it] INFO: Scrape type for PN93360: 2
2026-03-30 09:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa1480ce-4d07-58bb-9f18-6a35b429a113 with identifier: PN93360
2026-03-30 09:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa1480ce-4d07-58bb-9f18-6a35b429a113 with scrape type 2
2026-03-30 09:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa1480ce-4d07-58bb-9f18-6a35b429a113 with scrape type 2
2026-03-30 09:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa1480ce-4d07-58bb-9f18-6a35b429a113, identifier: PN93360
2026-03-30 09:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 59152a20-03e5-5c53-8083-4eb282cea514 with identifier: JC99655
2026-03-30 09:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 59152a20-03e5-5c53-8083-4eb282cea514 with identifier: JC99655
2026-03-30 09:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 59152a20-03e5-5c53-8083-4eb282cea514 with identifier: JC99655 to the API
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:58:07Z',
 'fuel_type': 'diesel',
 'id': '59152a20-03e5-5c53-8083-4eb282cea514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC99655',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 141796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-25',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2016}
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC99655%27 HTTP/1.1" 200 None
2026-03-30 09:14:07 [auto1.it] INFO: Saving data for JC99655: {'auction_closing_time': 1774886287.0, 'created_time': 1774688788.032365, 'last_price_update_time': 1774862047.802624}
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC99655') HTTP/1.1" 204 0
2026-03-30 09:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa1480ce-4d07-58bb-9f18-6a35b429a113 with identifier: PN93360
2026-03-30 09:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa1480ce-4d07-58bb-9f18-6a35b429a113 with identifier: PN93360
2026-03-30 09:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa1480ce-4d07-58bb-9f18-6a35b429a113 with identifier: PN93360 to the API
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:44:15Z',
 'fuel_type': 'diesel',
 'id': 'aa1480ce-4d07-58bb-9f18-6a35b429a113',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN93360',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 123513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-30',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi Energy BOSE-Edition',
 'transmission': 'manual',
 'trim': 'BOSE-Edition',
 'year': 2018}
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN93360%27 HTTP/1.1" 200 None
2026-03-30 09:14:08 [auto1.it] INFO: Saving data for PN93360: {'auction_closing_time': 1774885455.0, 'created_time': 1773954573.727023, 'last_price_update_time': 1774862048.077543}
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PN93360') HTTP/1.1" 204 0
2026-03-30 09:14:08 [auto1.it] INFO: Found listing with ID: YN59096
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN59096%27 HTTP/1.1" 200 None
2026-03-30 09:14:08 [auto1.it] INFO: Scrape type for YN59096: 2
2026-03-30 09:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with identifier: YN59096
2026-03-30 09:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with scrape type 2
2026-03-30 09:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with scrape type 2
2026-03-30 09:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cf4aafb8-fc4c-5af0-9866-506f8f82ce24, identifier: YN59096
2026-03-30 09:14:08 [auto1.it] INFO: Found listing with ID: WH30921
2026-03-30 09:14:08 [auto1.it] INFO: Found listing with ID: WC55302
2026-03-30 09:14:08 [auto1.it] INFO: Found listing with ID: GP46420
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP46420%27 HTTP/1.1" 200 None
2026-03-30 09:14:08 [auto1.it] INFO: Scrape type for GP46420: 2
2026-03-30 09:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67e9f24f-19d7-5232-a322-19d30db54d3d with identifier: GP46420
2026-03-30 09:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67e9f24f-19d7-5232-a322-19d30db54d3d with scrape type 2
2026-03-30 09:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67e9f24f-19d7-5232-a322-19d30db54d3d with scrape type 2
2026-03-30 09:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 67e9f24f-19d7-5232-a322-19d30db54d3d, identifier: GP46420
2026-03-30 09:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with identifier: YN59096
2026-03-30 09:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with identifier: YN59096
2026-03-30 09:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cf4aafb8-fc4c-5af0-9866-506f8f82ce24 with identifier: YN59096 to the API
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:00:25Z',
 'fuel_type': 'petrol',
 'id': 'cf4aafb8-fc4c-5af0-9866-506f8f82ce24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN59096',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 88015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-24',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up!',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2014}
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN59096%27 HTTP/1.1" 200 None
2026-03-30 09:14:08 [auto1.it] INFO: Saving data for YN59096: {'auction_closing_time': 1774882825.0, 'created_time': 1773954876.702786, 'last_price_update_time': 1774862048.604202}
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YN59096') HTTP/1.1" 204 0
2026-03-30 09:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 67e9f24f-19d7-5232-a322-19d30db54d3d with identifier: GP46420
2026-03-30 09:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 67e9f24f-19d7-5232-a322-19d30db54d3d with identifier: GP46420
2026-03-30 09:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 67e9f24f-19d7-5232-a322-19d30db54d3d with identifier: GP46420 to the API
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:46Z',
 'fuel_type': 'diesel',
 'id': '67e9f24f-19d7-5232-a322-19d30db54d3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP46420',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 330213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-05',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Xpossible ISG 2WD',
 'transmission': 'automatic',
 'trim': 'Xpossible ISG 2WD',
 'year': 2016}
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP46420%27 HTTP/1.1" 200 None
2026-03-30 09:14:08 [auto1.it] INFO: Saving data for GP46420: {'auction_closing_time': 1774885126.0, 'created_time': 1774688810.18422, 'last_price_update_time': 1774862048.991262}
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GP46420') HTTP/1.1" 204 0
2026-03-30 09:14:09 [auto1.it] INFO: Found listing with ID: PC10641
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC10641%27 HTTP/1.1" 200 None
2026-03-30 09:14:09 [auto1.it] INFO: Scrape type for PC10641: 2
2026-03-30 09:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a84ad904-aa71-56f3-b2cf-dd74edb750d3 with identifier: PC10641
2026-03-30 09:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a84ad904-aa71-56f3-b2cf-dd74edb750d3 with scrape type 2
2026-03-30 09:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a84ad904-aa71-56f3-b2cf-dd74edb750d3 with scrape type 2
2026-03-30 09:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a84ad904-aa71-56f3-b2cf-dd74edb750d3, identifier: PC10641
2026-03-30 09:14:09 [auto1.it] INFO: Found listing with ID: LD02725
2026-03-30 09:14:09 [auto1.it] INFO: Found listing with ID: SB80667
2026-03-30 09:14:09 [auto1.it] INFO: Found listing with ID: HW51602
2026-03-30 09:14:09 [auto1.it] INFO: Found listing with ID: DX75497
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX75497%27 HTTP/1.1" 200 None
2026-03-30 09:14:09 [auto1.it] INFO: Scrape type for DX75497: 2
2026-03-30 09:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with identifier: DX75497
2026-03-30 09:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with scrape type 2
2026-03-30 09:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with scrape type 2
2026-03-30 09:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 836b0b1d-3b05-5a9c-baaf-b3d91c48482d, identifier: DX75497
2026-03-30 09:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a84ad904-aa71-56f3-b2cf-dd74edb750d3 with identifier: PC10641
2026-03-30 09:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a84ad904-aa71-56f3-b2cf-dd74edb750d3 with identifier: PC10641
2026-03-30 09:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a84ad904-aa71-56f3-b2cf-dd74edb750d3 with identifier: PC10641 to the API
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:28Z',
 'fuel_type': 'diesel',
 'id': 'a84ad904-aa71-56f3-b2cf-dd74edb750d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC10641',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 145304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-28',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC10641%27 HTTP/1.1" 200 None
2026-03-30 09:14:09 [auto1.it] INFO: Saving data for PC10641: {'auction_closing_time': 1774883248.0, 'created_time': 1774688782.888622, 'last_price_update_time': 1774862049.504265}
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PC10641') HTTP/1.1" 204 0
2026-03-30 09:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with identifier: DX75497
2026-03-30 09:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with identifier: DX75497
2026-03-30 09:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 836b0b1d-3b05-5a9c-baaf-b3d91c48482d with identifier: DX75497 to the API
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:42:12Z',
 'fuel_type': 'diesel',
 'id': '836b0b1d-3b05-5a9c-baaf-b3d91c48482d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX75497',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 215682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-30',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2012}
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX75497%27 HTTP/1.1" 200 None
2026-03-30 09:14:09 [auto1.it] INFO: Saving data for DX75497: {'auction_closing_time': 1774885332.0, 'created_time': 1774343162.792023, 'last_price_update_time': 1774862049.793654}
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DX75497') HTTP/1.1" 204 0
2026-03-30 09:14:09 [auto1.it] INFO: Found listing with ID: MH04778
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH04778%27 HTTP/1.1" 200 None
2026-03-30 09:14:09 [auto1.it] INFO: Scrape type for MH04778: 2
2026-03-30 09:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 106f47da-14b9-5c47-a547-cea8110544c4 with identifier: MH04778
2026-03-30 09:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 106f47da-14b9-5c47-a547-cea8110544c4 with scrape type 2
2026-03-30 09:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 106f47da-14b9-5c47-a547-cea8110544c4 with scrape type 2
2026-03-30 09:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 106f47da-14b9-5c47-a547-cea8110544c4, identifier: MH04778
2026-03-30 09:14:09 [auto1.it] INFO: Found listing with ID: KF97174
2026-03-30 09:14:09 [auto1.it] INFO: Found listing with ID: UT33269
2026-03-30 09:14:09 [auto1.it] INFO: Found listing with ID: GJ33186
2026-03-30 09:14:09 [auto1.it] INFO: Found listing with ID: CJ50775
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ50775%27 HTTP/1.1" 200 None
2026-03-30 09:14:09 [auto1.it] INFO: Scrape type for CJ50775: 2
2026-03-30 09:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c with identifier: CJ50775
2026-03-30 09:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c with scrape type 2
2026-03-30 09:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c with scrape type 2
2026-03-30 09:14:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c, identifier: CJ50775
2026-03-30 09:14:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 09:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 106f47da-14b9-5c47-a547-cea8110544c4 with identifier: MH04778
2026-03-30 09:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 106f47da-14b9-5c47-a547-cea8110544c4 with identifier: MH04778
2026-03-30 09:14:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 106f47da-14b9-5c47-a547-cea8110544c4 with identifier: MH04778 to the API
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:48:28Z',
 'fuel_type': 'diesel',
 'id': '106f47da-14b9-5c47-a547-cea8110544c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH04778',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 195041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-02',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 CRDi VGT Dynamic',
 'transmission': 'automatic',
 'trim': 'VGT Dynamic',
 'year': 2008}
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH04778%27 HTTP/1.1" 200 None
2026-03-30 09:14:10 [auto1.it] INFO: Saving data for MH04778: {'auction_closing_time': 1774885708.0, 'created_time': 1774688808.639739, 'last_price_update_time': 1774862050.322522}
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MH04778') HTTP/1.1" 204 0
2026-03-30 09:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c with identifier: CJ50775
2026-03-30 09:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c with identifier: CJ50775
2026-03-30 09:14:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 94cbd0c5-ca26-5f13-9209-e84dda1c8d0c with identifier: CJ50775 to the API
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:18:30Z',
 'fuel_type': 'diesel',
 'id': '94cbd0c5-ca26-5f13-9209-e84dda1c8d0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ50775',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 223344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-02',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2016}
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ50775%27 HTTP/1.1" 200 None
2026-03-30 09:14:10 [auto1.it] INFO: Saving data for CJ50775: {'auction_closing_time': 1774883910.0, 'created_time': 1774688793.624155, 'last_price_update_time': 1774862050.601902}
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CJ50775') HTTP/1.1" 204 0
2026-03-30 09:14:10 [auto1.it] INFO: Found listing with ID: HG07035
2026-03-30 09:14:10 [auto1.it] INFO: Found listing with ID: RB57838
2026-03-30 09:14:10 [auto1.it] INFO: Found listing with ID: UW00940
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW00940%27 HTTP/1.1" 200 None
2026-03-30 09:14:10 [auto1.it] INFO: Scrape type for UW00940: 2
2026-03-30 09:14:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60156fbb-2377-5519-b136-be64270d3345 with identifier: UW00940
2026-03-30 09:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60156fbb-2377-5519-b136-be64270d3345 with scrape type 2
2026-03-30 09:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60156fbb-2377-5519-b136-be64270d3345 with scrape type 2
2026-03-30 09:14:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 60156fbb-2377-5519-b136-be64270d3345, identifier: UW00940
2026-03-30 09:14:10 [auto1.it] INFO: Found listing with ID: YB09690
2026-03-30 09:14:10 [auto1.it] INFO: Found listing with ID: UC99700
2026-03-30 09:14:10 [auto1.it] INFO: Found listing with ID: EG31110
2026-03-30 09:14:10 [auto1.it] INFO: Found listing with ID: SK62476
2026-03-30 09:14:10 [auto1.it] INFO: Found listing with ID: KR24813
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR24813%27 HTTP/1.1" 200 None
2026-03-30 09:14:10 [auto1.it] INFO: Scrape type for KR24813: 2
2026-03-30 09:14:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 688ac3ea-4c1c-578a-b56b-7bd327a99640 with identifier: KR24813
2026-03-30 09:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 688ac3ea-4c1c-578a-b56b-7bd327a99640 with scrape type 2
2026-03-30 09:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 688ac3ea-4c1c-578a-b56b-7bd327a99640 with scrape type 2
2026-03-30 09:14:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 688ac3ea-4c1c-578a-b56b-7bd327a99640, identifier: KR24813
2026-03-30 09:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 60156fbb-2377-5519-b136-be64270d3345 with identifier: UW00940
2026-03-30 09:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 60156fbb-2377-5519-b136-be64270d3345 with identifier: UW00940
2026-03-30 09:14:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 60156fbb-2377-5519-b136-be64270d3345 with identifier: UW00940 to the API
2026-03-30 09:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-30T15:13:45Z',
 'fuel_type': 'hybrid',
 'id': '60156fbb-2377-5519-b136-be64270d3345',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW00940',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 105731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-24',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T4 Recharge Plug-in Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2022}
2026-03-30 09:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW00940%27 HTTP/1.1" 200 None
2026-03-30 09:14:11 [auto1.it] INFO: Saving data for UW00940: {'auction_closing_time': 1774883625.0, 'created_time': 1774688804.647924, 'last_price_update_time': 1774862051.775431}
2026-03-30 09:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW00940') HTTP/1.1" 204 0
2026-03-30 09:14:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 688ac3ea-4c1c-578a-b56b-7bd327a99640 with identifier: KR24813
2026-03-30 09:14:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 688ac3ea-4c1c-578a-b56b-7bd327a99640 with identifier: KR24813
2026-03-30 09:14:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 688ac3ea-4c1c-578a-b56b-7bd327a99640 with identifier: KR24813 to the API
2026-03-30 09:14:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:06:03Z',
 'fuel_type': 'diesel',
 'id': '688ac3ea-4c1c-578a-b56b-7bd327a99640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR24813',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 97558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR24813%27 HTTP/1.1" 200 None
2026-03-30 09:14:12 [auto1.it] INFO: Saving data for KR24813: {'auction_closing_time': 1774883163.0, 'created_time': 1774688785.893629, 'last_price_update_time': 1774862052.144077}
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KR24813') HTTP/1.1" 204 0
2026-03-30 09:14:12 [auto1.it] INFO: Found listing with ID: PD21393
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD21393%27 HTTP/1.1" 200 None
2026-03-30 09:14:12 [auto1.it] INFO: Scrape type for PD21393: 2
2026-03-30 09:14:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with identifier: PD21393
2026-03-30 09:14:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with scrape type 2
2026-03-30 09:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with scrape type 2
2026-03-30 09:14:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643, identifier: PD21393
2026-03-30 09:14:12 [auto1.it] INFO: Found listing with ID: WL53741
2026-03-30 09:14:12 [auto1.it] INFO: Found listing with ID: KK99486
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK99486%27 HTTP/1.1" 200 None
2026-03-30 09:14:12 [auto1.it] INFO: Scrape type for KK99486: 2
2026-03-30 09:14:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with identifier: KK99486
2026-03-30 09:14:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with scrape type 2
2026-03-30 09:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with scrape type 2
2026-03-30 09:14:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93, identifier: KK99486
2026-03-30 09:14:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with identifier: PD21393
2026-03-30 09:14:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with identifier: PD21393
2026-03-30 09:14:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643 with identifier: PD21393 to the API
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:28:11Z',
 'fuel_type': 'petrol',
 'id': '3c4c89f3-b5e6-56a2-ace1-9bf03f7f9643',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD21393',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 159572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-18',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Argento',
 'transmission': 'manual',
 'trim': 'Argento',
 'year': 2006}
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD21393%27 HTTP/1.1" 200 None
2026-03-30 09:14:12 [auto1.it] INFO: Saving data for PD21393: {'auction_closing_time': 1774884491.0, 'created_time': 1774688825.870316, 'last_price_update_time': 1774862052.627328}
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PD21393') HTTP/1.1" 204 0
2026-03-30 09:14:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with identifier: KK99486
2026-03-30 09:14:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with identifier: KK99486
2026-03-30 09:14:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93 with identifier: KK99486 to the API
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:11:47Z',
 'fuel_type': 'diesel',
 'id': '8ac7dc09-ed04-5f41-b8fb-f39a32a7fb93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK99486',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 390510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-04',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2007}
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK99486%27 HTTP/1.1" 200 None
2026-03-30 09:14:12 [auto1.it] INFO: Saving data for KK99486: {'auction_closing_time': 1774883507.0, 'created_time': 1773129555.083647, 'last_price_update_time': 1774862052.894332}
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KK99486') HTTP/1.1" 204 0
2026-03-30 09:14:12 [auto1.it] INFO: Channel: 24h | Page: 84 | totalHits: 3314 | hits on page: 0
2026-03-30 09:14:12 [auto1.it] INFO: Found listing with ID: CR16346
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR16346%27 HTTP/1.1" 200 None
2026-03-30 09:14:12 [auto1.it] INFO: Scrape type for CR16346: 2
2026-03-30 09:14:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with identifier: CR16346
2026-03-30 09:14:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with scrape type 2
2026-03-30 09:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with scrape type 2
2026-03-30 09:14:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26, identifier: CR16346
2026-03-30 09:14:13 [auto1.it] INFO: Found listing with ID: XW14976
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW14976%27 HTTP/1.1" 200 None
2026-03-30 09:14:13 [auto1.it] INFO: Scrape type for XW14976: 2
2026-03-30 09:14:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with identifier: XW14976
2026-03-30 09:14:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with scrape type 2
2026-03-30 09:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with scrape type 2
2026-03-30 09:14:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7ebd1c3-b242-585c-a31e-72018cbd5ae9, identifier: XW14976
2026-03-30 09:14:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with identifier: CR16346
2026-03-30 09:14:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with identifier: CR16346
2026-03-30 09:14:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26 with identifier: CR16346 to the API
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:42:01Z',
 'fuel_type': 'diesel',
 'id': 'b0ecb0c0-ce15-5dbb-887d-1a23e82a4f26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR16346',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 112504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-30',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR16346%27 HTTP/1.1" 200 None
2026-03-30 09:14:13 [auto1.it] INFO: Saving data for CR16346: {'auction_closing_time': 1774885321.0, 'created_time': 1774688822.412675, 'last_price_update_time': 1774862053.38425}
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CR16346') HTTP/1.1" 204 0
2026-03-30 09:14:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with identifier: XW14976
2026-03-30 09:14:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with identifier: XW14976
2026-03-30 09:14:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d7ebd1c3-b242-585c-a31e-72018cbd5ae9 with identifier: XW14976 to the API
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:47:05Z',
 'fuel_type': 'diesel',
 'id': 'd7ebd1c3-b242-585c-a31e-72018cbd5ae9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW14976',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 186471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-22',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2017}
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW14976%27 HTTP/1.1" 200 None
2026-03-30 09:14:13 [auto1.it] INFO: Saving data for XW14976: {'auction_closing_time': 1774885625.0, 'created_time': 1773997743.881776, 'last_price_update_time': 1774862053.674264}
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XW14976') HTTP/1.1" 204 0
2026-03-30 09:14:13 [auto1.it] INFO: Found listing with ID: AU50392
2026-03-30 09:14:13 [auto1.it] INFO: Found listing with ID: XK62729
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK62729%27 HTTP/1.1" 200 None
2026-03-30 09:14:13 [auto1.it] INFO: Scrape type for XK62729: 2
2026-03-30 09:14:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffbc101d-1cce-5619-9943-d813bcfb86bc with identifier: XK62729
2026-03-30 09:14:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffbc101d-1cce-5619-9943-d813bcfb86bc with scrape type 2
2026-03-30 09:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffbc101d-1cce-5619-9943-d813bcfb86bc with scrape type 2
2026-03-30 09:14:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ffbc101d-1cce-5619-9943-d813bcfb86bc, identifier: XK62729
2026-03-30 09:14:13 [auto1.it] INFO: Found listing with ID: CV32353
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV32353%27 HTTP/1.1" 200 None
2026-03-30 09:14:13 [auto1.it] INFO: Scrape type for CV32353: 2
2026-03-30 09:14:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e044c2-49f2-53e9-9e8d-8c20364b2728 with identifier: CV32353
2026-03-30 09:14:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e044c2-49f2-53e9-9e8d-8c20364b2728 with scrape type 2
2026-03-30 09:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e044c2-49f2-53e9-9e8d-8c20364b2728 with scrape type 2
2026-03-30 09:14:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 75e044c2-49f2-53e9-9e8d-8c20364b2728, identifier: CV32353
2026-03-30 09:14:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ffbc101d-1cce-5619-9943-d813bcfb86bc with identifier: XK62729
2026-03-30 09:14:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ffbc101d-1cce-5619-9943-d813bcfb86bc with identifier: XK62729
2026-03-30 09:14:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ffbc101d-1cce-5619-9943-d813bcfb86bc with identifier: XK62729 to the API
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:08:00Z',
 'fuel_type': 'diesel',
 'id': 'ffbc101d-1cce-5619-9943-d813bcfb86bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK62729',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 170446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2018}
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK62729%27 HTTP/1.1" 200 None
2026-03-30 09:14:14 [auto1.it] INFO: Saving data for XK62729: {'auction_closing_time': 1774883280.0, 'created_time': 1774688807.074228, 'last_price_update_time': 1774862054.211615}
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XK62729') HTTP/1.1" 204 0
2026-03-30 09:14:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 75e044c2-49f2-53e9-9e8d-8c20364b2728 with identifier: CV32353
2026-03-30 09:14:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 75e044c2-49f2-53e9-9e8d-8c20364b2728 with identifier: CV32353
2026-03-30 09:14:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 75e044c2-49f2-53e9-9e8d-8c20364b2728 with identifier: CV32353 to the API
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:27:14Z',
 'fuel_type': 'diesel',
 'id': '75e044c2-49f2-53e9-9e8d-8c20364b2728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV32353',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 148237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-16',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2015}
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV32353%27 HTTP/1.1" 200 None
2026-03-30 09:14:14 [auto1.it] INFO: Saving data for CV32353: {'auction_closing_time': 1774884434.0, 'created_time': 1773130269.150676, 'last_price_update_time': 1774862054.497936}
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV32353') HTTP/1.1" 204 0
2026-03-30 09:14:14 [auto1.it] INFO: Found listing with ID: BD17279
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD17279%27 HTTP/1.1" 200 None
2026-03-30 09:14:14 [auto1.it] INFO: Scrape type for BD17279: 2
2026-03-30 09:14:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with identifier: BD17279
2026-03-30 09:14:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with scrape type 2
2026-03-30 09:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with scrape type 2
2026-03-30 09:14:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1, identifier: BD17279
2026-03-30 09:14:14 [auto1.it] INFO: Found listing with ID: YE49798
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE49798%27 HTTP/1.1" 200 None
2026-03-30 09:14:14 [auto1.it] INFO: Scrape type for YE49798: 2
2026-03-30 09:14:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e70bfe3-326a-59c3-bf90-656e01b615c2 with identifier: YE49798
2026-03-30 09:14:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e70bfe3-326a-59c3-bf90-656e01b615c2 with scrape type 2
2026-03-30 09:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e70bfe3-326a-59c3-bf90-656e01b615c2 with scrape type 2
2026-03-30 09:14:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e70bfe3-326a-59c3-bf90-656e01b615c2, identifier: YE49798
2026-03-30 09:14:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with identifier: BD17279
2026-03-30 09:14:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with identifier: BD17279
2026-03-30 09:14:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1 with identifier: BD17279 to the API
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:34:37Z',
 'fuel_type': 'diesel',
 'id': '8bcd0a4c-f292-5d43-b1e9-c5c9d1a8fbc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD17279',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 176031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-11',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2016}
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD17279%27 HTTP/1.1" 200 None
2026-03-30 09:14:15 [auto1.it] INFO: Saving data for BD17279: {'auction_closing_time': 1774884877.0, 'created_time': 1773954829.453781, 'last_price_update_time': 1774862055.023147}
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BD17279') HTTP/1.1" 204 0
2026-03-30 09:14:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e70bfe3-326a-59c3-bf90-656e01b615c2 with identifier: YE49798
2026-03-30 09:14:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e70bfe3-326a-59c3-bf90-656e01b615c2 with identifier: YE49798
2026-03-30 09:14:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e70bfe3-326a-59c3-bf90-656e01b615c2 with identifier: YE49798 to the API
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:58:07Z',
 'fuel_type': 'diesel',
 'id': '4e70bfe3-326a-59c3-bf90-656e01b615c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE49798',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 117555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Fiat 500X 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE49798%27 HTTP/1.1" 200 None
2026-03-30 09:14:15 [auto1.it] INFO: Saving data for YE49798: {'auction_closing_time': 1774886287.0, 'created_time': 1774688789.341924, 'last_price_update_time': 1774862055.320077}
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YE49798') HTTP/1.1" 204 0
2026-03-30 09:14:15 [auto1.it] INFO: Found listing with ID: VV69855
2026-03-30 09:14:15 [auto1.it] INFO: Found listing with ID: WP22813
2026-03-30 09:14:15 [auto1.it] INFO: Found listing with ID: PZ74443
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ74443%27 HTTP/1.1" 200 None
2026-03-30 09:14:15 [auto1.it] INFO: Scrape type for PZ74443: 2
2026-03-30 09:14:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fcbeaf6-ccb5-5903-89be-190be0822dba with identifier: PZ74443
2026-03-30 09:14:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fcbeaf6-ccb5-5903-89be-190be0822dba with scrape type 2
2026-03-30 09:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fcbeaf6-ccb5-5903-89be-190be0822dba with scrape type 2
2026-03-30 09:14:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1fcbeaf6-ccb5-5903-89be-190be0822dba, identifier: PZ74443
2026-03-30 09:14:15 [auto1.it] INFO: Found listing with ID: RB84694
2026-03-30 09:14:15 [auto1.it] INFO: Found listing with ID: DJ31826
2026-03-30 09:14:15 [auto1.it] INFO: Found listing with ID: UL30423
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL30423%27 HTTP/1.1" 200 None
2026-03-30 09:14:15 [auto1.it] INFO: Scrape type for UL30423: 2
2026-03-30 09:14:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4530052-df44-52af-ac60-a09aba23674a with identifier: UL30423
2026-03-30 09:14:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4530052-df44-52af-ac60-a09aba23674a with scrape type 2
2026-03-30 09:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4530052-df44-52af-ac60-a09aba23674a with scrape type 2
2026-03-30 09:14:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4530052-df44-52af-ac60-a09aba23674a, identifier: UL30423
2026-03-30 09:14:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1fcbeaf6-ccb5-5903-89be-190be0822dba with identifier: PZ74443
2026-03-30 09:14:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1fcbeaf6-ccb5-5903-89be-190be0822dba with identifier: PZ74443
2026-03-30 09:14:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1fcbeaf6-ccb5-5903-89be-190be0822dba with identifier: PZ74443 to the API
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:05:27Z',
 'fuel_type': 'diesel',
 'id': '1fcbeaf6-ccb5-5903-89be-190be0822dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ74443',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 213942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-27',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ74443%27 HTTP/1.1" 200 None
2026-03-30 09:14:16 [auto1.it] INFO: Saving data for PZ74443: {'auction_closing_time': 1774883127.0, 'created_time': 1774688814.289607, 'last_price_update_time': 1774862056.032581}
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ74443') HTTP/1.1" 204 0
2026-03-30 09:14:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4530052-df44-52af-ac60-a09aba23674a with identifier: UL30423
2026-03-30 09:14:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4530052-df44-52af-ac60-a09aba23674a with identifier: UL30423
2026-03-30 09:14:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4530052-df44-52af-ac60-a09aba23674a with identifier: UL30423 to the API
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:31:16Z',
 'fuel_type': 'petrol',
 'id': 'b4530052-df44-52af-ac60-a09aba23674a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL30423',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 116248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-01',
 'seller_name': None,
 'title': 'Honda Civic 1.4 DSi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL30423%27 HTTP/1.1" 200 None
2026-03-30 09:14:16 [auto1.it] INFO: Saving data for UL30423: {'auction_closing_time': 1774884676.0, 'created_time': 1773129793.8563, 'last_price_update_time': 1774862056.385597}
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UL30423') HTTP/1.1" 204 0
2026-03-30 09:14:16 [auto1.it] INFO: Found listing with ID: DF91853
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF91853%27 HTTP/1.1" 200 None
2026-03-30 09:14:16 [auto1.it] INFO: Scrape type for DF91853: 2
2026-03-30 09:14:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with identifier: DF91853
2026-03-30 09:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with scrape type 2
2026-03-30 09:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with scrape type 2
2026-03-30 09:14:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd66edc9-6f36-54da-94f3-f4d6f1fbd23e, identifier: DF91853
2026-03-30 09:14:16 [auto1.it] INFO: Found listing with ID: MT45417
2026-03-30 09:14:16 [auto1.it] INFO: Found listing with ID: FV07755
2026-03-30 09:14:16 [auto1.it] INFO: Found listing with ID: SW75734
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW75734%27 HTTP/1.1" 200 None
2026-03-30 09:14:16 [auto1.it] INFO: Scrape type for SW75734: 2
2026-03-30 09:14:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd326e37-9ee5-51ed-958e-cbeba9f9d3af with identifier: SW75734
2026-03-30 09:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd326e37-9ee5-51ed-958e-cbeba9f9d3af with scrape type 2
2026-03-30 09:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd326e37-9ee5-51ed-958e-cbeba9f9d3af with scrape type 2
2026-03-30 09:14:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd326e37-9ee5-51ed-958e-cbeba9f9d3af, identifier: SW75734
2026-03-30 09:14:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with identifier: DF91853
2026-03-30 09:14:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with identifier: DF91853
2026-03-30 09:14:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd66edc9-6f36-54da-94f3-f4d6f1fbd23e with identifier: DF91853 to the API
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:32:40Z',
 'fuel_type': 'petrol',
 'id': 'fd66edc9-6f36-54da-94f3-f4d6f1fbd23e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF91853',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Musa',
 'odometer': 201063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-26',
 'seller_name': None,
 'title': 'Lancia Musa 1.4 E-Collection',
 'transmission': 'manual',
 'trim': 'E-Collection',
 'year': 2010}
2026-03-30 09:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF91853%27 HTTP/1.1" 200 None
2026-03-30 09:14:17 [auto1.it] INFO: Saving data for DF91853: {'auction_closing_time': 1774884760.0, 'created_time': 1774688823.494932, 'last_price_update_time': 1774862057.153716}
2026-03-30 09:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DF91853') HTTP/1.1" 204 0
2026-03-30 09:14:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd326e37-9ee5-51ed-958e-cbeba9f9d3af with identifier: SW75734
2026-03-30 09:14:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd326e37-9ee5-51ed-958e-cbeba9f9d3af with identifier: SW75734
2026-03-30 09:14:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd326e37-9ee5-51ed-958e-cbeba9f9d3af with identifier: SW75734 to the API
2026-03-30 09:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 09:14:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 09:14:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:27:43Z',
 'fuel_type': 'petrol',
 'id': 'cd326e37-9ee5-51ed-958e-cbeba9f9d3af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW75734',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 85791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-11',
 'seller_name': None,
 'title': 'Renault Modus 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2010}
2026-03-30 09:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW75734%27 HTTP/1.1" 200 None
2026-03-30 09:14:17 [auto1.it] INFO: Saving data for SW75734: {'auction_closing_time': 1774884463.0, 'created_time': 1774688789.678129, 'last_price_update_time': 1774862057.450524}
2026-03-30 09:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 09:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SW75734') HTTP/1.1" 204 0
2026-03-30 09:14:17 [auto1.it] INFO: Found listing with ID: NA17081
2026-03-30 09:14:17 [auto1.it] INFO: Found listing with ID: KA05234
2026-03-30 09:14:17 [auto1.it] INFO: Found listing with ID: XL36522
2026-03-30 09:14:17 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 09:14:17 [auto1.it] INFO: auto1.it Batch config: batch 2/2
2026-03-30 09:14:17 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 2, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 5}
2026-03-30 09:14:17 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (651 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_23_2026-03-30T09_05_00.jl
2026-03-30 09:14:17 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1828036,
 'downloader/request_count': 1046,
 'downloader/request_method_count/GET': 960,
 'downloader/request_method_count/POST': 86,
 'downloader/response_bytes': 270479031,
 'downloader/response_count': 1046,
 'downloader/response_status_count/200': 1046,
 'dupefilter/filtered': 16,
 'elapsed_time_seconds': 553.445787,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 9, 14, 17, 568675, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 651,
 'log_count/DEBUG': 14716,
 'log_count/INFO': 15975,
 'memusage/max': 204120064,
 'memusage/startup': 150093824,
 'photo_download_count': 710,
 'request_depth_max': 87,
 'response_received_count': 336,
 'scheduler/dequeued': 1046,
 'scheduler/dequeued/memory': 1046,
 'scheduler/enqueued': 1046,
 'scheduler/enqueued/memory': 1046,
 'scrape_type/batch_skipped': 1662,
 'scrape_type/new': 124,
 'scrape_type/price_update': 527,
 'scrape_type/skipped': 1025,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 336,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 5.015952023195238,
 'scrapy-zyte-api/mean_response_seconds': 5.041868216753108,
 'scrapy-zyte-api/processed': 336,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 336,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 335,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 336,
 'scrapy-zyte-api/request_args/httpRequestBody': 86,
 'scrapy-zyte-api/request_args/httpRequestMethod': 86,
 'scrapy-zyte-api/request_args/httpResponseBody': 336,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 336,
 'scrapy-zyte-api/request_args/sessionContext': 336,
 'scrapy-zyte-api/request_args/url': 336,
 'scrapy-zyte-api/status_codes/200': 336,
 'scrapy-zyte-api/success': 336,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 3354,
 'source/total_available': 3314,
 'start_time': datetime.datetime(2026, 3, 30, 9, 5, 4, 122888, tzinfo=datetime.timezone.utc)}
2026-03-30 09:14:17 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 09:14:17 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0ee4626210>
2026-03-30 09:14:17 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0ee4626610>